From: | Bruce Momjian <bruce(at)momjian(dot)us> |
---|---|
To: | Hitoshi Harada <umi(dot)tanuki(at)gmail(dot)com> |
Cc: | Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org> |
Subject: | Re: tuplestore potential performance problem |
Date: | 2009-01-15 01:32:16 |
Message-ID: | 200901150132.n0F1WGe10799@momjian.us |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
Has this been addressed?
---------------------------------------------------------------------------
Hitoshi Harada wrote:
> 2008/12/3 Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>:
> > If this means a lot of contortion/complication in the upper-level code,
> > seems like it'd be better to address the performance issue within
> > tuplestore/buffile. We could keep separate buffers for write and read
> > perhaps. But do you have real evidence of a performance problem?
> > I'd sort of expect the kernel's disk cache to mitigate this pretty well.
> >
> > regards, tom lane
> >
> I don't have real evidence but reasoned it. No strace was done. So it
> may not be cased by flushing out but this commit gets performance
> quite better, to earlier patch performance, around 44sec from around
> 76sec.
>
> http://git.postgresql.org/?p=~davidfetter/window_functions/.git;a=commitdiff;h=87d9b8ac5dca9fae5f3ac4f3218d8fb4eca8b5b0;hp=f1976a9d002b20006ac31ca85db27abcf56e9ea2
>
> where pos = -1 means spool all rows until the end.
>
> The "earlier" approach was buffering all the table and the newer
> Heikki's approach was buffer on row by row while reading. The newest
> is buffering row by row while reading during in memory, and holding
> all the remaining tuples before reading after out to file, something
> like hybrid method.
>
> Regards,
>
> --
> Hitoshi Harada
>
> --
> Sent via pgsql-hackers mailing list (pgsql-hackers(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-hackers
--
Bruce Momjian <bruce(at)momjian(dot)us> http://momjian.us
EnterpriseDB http://enterprisedb.com
+ If your life is a hard drive, Christ can be your backup. +
From | Date | Subject | |
---|---|---|---|
Next Message | Gregory Stark | 2009-01-15 01:40:33 | Re: Visibility map, partial vacuums |
Previous Message | Bruce Momjian | 2009-01-15 01:31:11 | Re: Visibility map, partial vacuums |