Re: Large shared_buffer stalls WAS: proposal: Set effective_cache_size to greater of .conf value, shared_buffers

From: Merlin Moncure <mmoncure(at)gmail(dot)com>
To: Josh Berkus <josh(at)agliodbs(dot)com>
Cc: Andres Freund <andres(at)2ndquadrant(dot)com>, Robert Haas <robertmhaas(at)gmail(dot)com>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Large shared_buffer stalls WAS: proposal: Set effective_cache_size to greater of .conf value, shared_buffers
Date: 2013-09-13 19:55:16
Message-ID: CAHyXU0x+npMkCPVQRhdWhcJ_5QWKaUmySRHVzz8NAEkzrR=_Vg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Sep 13, 2013 at 2:36 PM, Josh Berkus <josh(at)agliodbs(dot)com> wrote:
> On 09/13/2013 09:27 AM, Merlin Moncure wrote:
>> I happen to be one of those "couple" people. Load goes from 0.1 to
>> 500 without warning then back to 0.1 equally without warning.
>> Unfortunately the server is in a different jurisdiction such that it
>> makes deep forensic analysis impossible. I think this is happening
>> more and more often as postgres is becoming increasingly deployed on
>> high(er) -end servers. I've personally (alone) dealt with 4-5
>> confirmed cases and there have been many more. We have a problem.
>
> Can you explain a bit more about this? I'm currently grappling with a
> db cluster which has periodic mysterious total LWLock paralysis, and is
> configured with 8GB shared_buffers (and 512GB ram installed).

see thread: http://postgresql.1045698.n5.nabble.com/StrategyGetBuffer-optimization-take-2-td5766307.html
plus others. In this particular case, s_b needs to be set to 2GB or
lower (they tried raising to 4GB for no good reason) and problem
reoccured.

what are the specific symptoms of your problem? anything interesting
in pg_locks? is $client willing to experiment with custom patches?

merlin

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Josh Berkus 2013-09-13 20:20:52 Re: Large shared_buffer stalls WAS: proposal: Set effective_cache_size to greater of .conf value, shared_buffers
Previous Message Stephen Frost 2013-09-13 19:41:09 Re: Strange hanging bug in a simple milter