From:
Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To:
ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
Cc:
Greg Smith <gsmith(at)gregsmith(dot)com>, pgsql-patches(at)postgresql(dot)org
Subject:
Re: Sorting writes during checkpoint
Date:
2008-05-04 04:40:19
Message-ID:
4421.1209876019@sss.pgh.pa.us (view raw or flat )
Thread:
2007-06-06 13:19:12 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-06 14:14:14 from Gregory Stark <stark(at)enterprisedb(dot)com>
2007-06-06 15:03:25 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2007-06-06 18:05:35 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-07 09:28:03 from Hannu Krosing <hannu(at)skype(dot)net>
2007-06-06 18:26:11 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-07 08:36:53 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-07 18:58:50 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-07 19:28:27 from Gregory Stark <stark(at)enterprisedb(dot)com>
2007-06-07 20:49:17 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-07 20:56:14 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2007-06-08 00:33:38 from Josh Berkus <josh(at)agliodbs(dot)com>
2007-06-08 00:43:18 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2007-06-08 01:19:50 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2007-06-12 19:49:06 from Josh Berkus <josh(at)agliodbs(dot)com>
2007-06-12 19:51:46 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2007-06-12 20:08:01 from Josh Berkus <josh(at)agliodbs(dot)com>
2007-06-08 08:50:49 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-08 14:10:43 from Andrew Sullivan <ajs(at)crankycanuck(dot)ca>
2007-06-08 14:21:10 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-08 14:33:50 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-08 15:06:09 from Andrew Sullivan <ajs(at)crankycanuck(dot)ca>
2007-06-08 18:36:54 from Bruce Momjian <bruce(at)momjian(dot)us>
2007-06-07 12:23:06 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-07 14:16:25 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2007-06-07 17:23:41 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-07 17:43:49 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2007-06-07 17:59:28 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-11 06:27:48 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2007-06-11 07:51:51 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-14 07:39:37 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2007-06-14 11:45:21 from Gregory Stark <stark(at)enterprisedb(dot)com>
2007-06-14 13:22:06 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-14 15:58:33 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-14 17:50:17 from "Simon Riggs" <simon(at)2ndquadrant(dot)com>
2007-06-15 02:37:14 from "Gregory Maxwell" <gmaxwell(at)gmail(dot)com>
2007-06-15 04:53:41 from Greg Smith <gsmith(at)gregsmith(dot)com>
2007-06-15 09:14:20 from "Zeugswetter Andreas ADI SD" <ZeugswetterA(at)spardat(dot)at>
2007-06-15 09:33:47 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2007-06-15 10:55:02 from "Simon Riggs" <simon(at)2ndquadrant(dot)com>
2008-03-11 20:05:01 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-04-15 09:19:43 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2008-04-15 13:16:40 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-04-16 04:22:13 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2008-04-16 22:02:38 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-05-04 04:40:19 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-04 23:12:32 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-05-04 23:35:46 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-05 02:43:13 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-05-05 04:23:55 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-05 05:37:28 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-07-04 08:37:10 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-07-04 16:05:54 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-07-04 16:22:23 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-07-07 01:29:15 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2008-07-16 05:19:22 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-07-10 01:39:29 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-07-10 07:06:12 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2007-06-11 09:27:30 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-09 07:39:19 from "Jim C(dot) Nasby" <decibel(at)decibel(dot)org>
2007-06-10 19:49:24 from Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
2007-06-13 18:05:23 from "Jim C(dot) Nasby" <decibel(at)decibel(dot)org>
2007-06-13 22:09:02 from PFC <lists(at)peufeu(dot)com>
2007-06-14 11:40:51 from Gregory Stark <stark(at)enterprisedb(dot)com>
2007-06-13 22:04:57 from "Florian G(dot) Pflug" <fgp(at)phlo(dot)org>
Lists:
pgsql-hackers pgsql-patches
ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp> writes:
> Greg Smith <gsmith(at)gregsmith(dot)com> wrote:
>> If shared_buffers(=NBuffers) is set to something big, this could give some
>> memory churn. And I think it's a bad idea to allocate something this
>> large at checkpoint time, because what happens if that fails? Really not
>> the time you want to discover there's no RAM left.
> Hmm, but I think we need to copy buffer tags into bgwriter's local memory
> in order to avoid locking taga many times in the sorting.
I updated this patch to permanently allocate the working array as Greg
suggests, and to fix a bunch of commenting issues (attached).
However, I am completely unable to measure any performance improvement
from it. Given the possible risk of out-of-memory failures, I think the
patch should not be applied without some direct proof of performance
benefits, and I don't see any.
regards, tom lane
In response to
Responses
pgsql-hackers by date
Next :From: Euler Taveira de OliveiraDate: 2008-05-04 05:21:41
Subject : Re: Patch for Prevent pg_dump/pg_restore from being affected
by statement_timeout
Previous :From : Tom LaneDate : 2008-05-04 00:55:31
Subject : Re: [HACKERS] Multiline privileges in \z
pgsql-patches by date
Next :From: Euler Taveira de OliveiraDate: 2008-05-04 05:21:41
Subject : Re: Patch for Prevent pg_dump/pg_restore from being affected
by statement_timeout
Previous :From : Tom LaneDate : 2008-05-04 00:55:31
Subject : Re: [HACKERS] Multiline privileges in \z