pgsql: Improve control logic for bgwriter hibernation mode.

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Improve control logic for bgwriter hibernation mode.
Date: 2012-05-10 03:37:38
Message-ID: E1SSKCA-0000M8-5M@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Improve control logic for bgwriter hibernation mode.

Commit 6d90eaaa89a007e0d365f49d6436f35d2392cfeb added a hibernation mode
to the bgwriter to reduce the server's idle-power consumption. However,
its interaction with the detailed behavior of BgBufferSync's feedback
control loop wasn't very well thought out. That control loop depends
primarily on the rate of buffer allocation, not the rate of buffer
dirtying, so the hibernation mode has to be designed to operate only when
no new buffer allocations are happening. Also, the check for whether the
system is effectively idle was not quite right and would fail to detect
a constant low level of activity, thus allowing the bgwriter to go into
hibernation mode in a way that would let the cycle time vary quite a bit,
possibly further confusing the feedback loop. To fix, move the wakeup
support from MarkBufferDirty and SetBufferCommitInfoNeedsSave into
StrategyGetBuffer, and prevent the bgwriter from entering hibernation mode
unless no buffer allocations have happened recently.

In addition, fix the delaying logic to remove the problem of possibly not
responding to signals promptly, which was basically caused by trying to use
the process latch's is_set flag for multiple purposes. I can't prove it
but I'm suspicious that that hack was responsible for the intermittent
"postmaster does not shut down" failures we've been seeing in the buildfarm
lately. In any case it did nothing to improve the readability or
robustness of the code.

In passing, express the hibernation sleep time as a multiplier on
BgWriterDelay, not a constant. I'm not sure whether there's any value in
exposing the longer sleep time as an independently configurable setting,
but we can at least make it act like this for little extra code.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/6308ba05a7a24b5137d97508300131ffa42051c2

Modified Files
--------------
src/backend/postmaster/bgwriter.c | 196 +++++++++++----------------------
src/backend/storage/buffer/bufmgr.c | 58 +++++------
src/backend/storage/buffer/freelist.c | 45 ++++++++
src/backend/storage/lmgr/proc.c | 4 +-
src/include/postmaster/bgwriter.h | 6 +-
src/include/storage/buf_internals.h | 3 +
src/include/storage/proc.h | 2 -
7 files changed, 145 insertions(+), 169 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Tom Lane 2012-05-10 04:01:20 pgsql: Further tweaking of nomenclature in checkpointer.c.
Previous Message Bruce Momjian 2012-05-10 02:25:55 pgsql: Publish draft version of Postgres 9.2 release notes.