Re: Readme of Buffer Management seems to have wrong sentence

From: Robert Haas <robertmhaas(at)gmail(dot)com>
To: Jeff Janes <jeff(dot)janes(at)gmail(dot)com>
Cc: Amit Kapila <amit(dot)kapila(at)huawei(dot)com>, Greg Smith <greg(at)2ndquadrant(dot)com>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: Readme of Buffer Management seems to have wrong sentence
Date: 2012-05-23 19:03:45
Message-ID: CA+TgmoapTUM-u-JtVDeq29GC8M1xXYQzju5p0_6qf6_d_js27w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, May 23, 2012 at 2:09 PM, Jeff Janes <jeff(dot)janes(at)gmail(dot)com> wrote:
> On Wed, May 23, 2012 at 10:33 AM, Amit Kapila <amit(dot)kapila(at)huawei(dot)com> wrote:
>>>>I don't think there is a clear picture yet of what benchmark to use for
>> testing changes here.
>> I will first try to generate such a scenario(benchmark). I have still not
>> thought completely.
>> However the idea in my mind is that scenario where buffer list is heavily
>> operated upon.
>> Operations where shared buffers are much less compare to the data in disk
>> and the operations are distributed such that
>> they require to access most of the data in disk randomly.
>
> If most buffer reads actually have to read from disk, then that will
> so throttle your throughput that you will not be able to make anything
> else be relevant.  You need to have shared_buffers be much smaller
> than RAM, and have almost all the "disk" data resident in RAM but not
> in shared_buffers.

But this is pretty common, since we advise people to set
shared_buffers relatively low as compared to physical memory. The
problem is visible on the graph I posted here:

http://rhaas.blogspot.com/2012/03/performance-and-scalability-on-ibm.html

When the scale factor gets large enough to exceed shared_buffers,
performance peaks in the 36-44 client range. When it's small enough
to fit in shared_buffers, performance continues to increase through 64
clients and even a bit beyond. Note that the absolute *performance*
is not much worse with the larger scale factor, if you have only one
client. It's the *scalability* that goes out the window.

--
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Robert Haas 2012-05-23 19:20:45 adding and upgrading metapages
Previous Message Jeff Janes 2012-05-23 19:03:28 Re: Readme of Buffer Management seems to have wrong sentence