From:
"scott(dot)marlowe" <scott(dot)marlowe(at)ihs(dot)com>
To:
Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc:
Jan Wieck <JanWieck(at)Yahoo(dot)com>,Ang Chin Han <angch(at)bytecraft(dot)com(dot)my>,Christopher Browne <cbbrowne(at)acm(dot)org>, <pgsql-hackers(at)postgresql(dot)org>
Subject:
Re: Experimental patch for inter-page delay in VACUUM
Date:
2003-11-04 20:41:30
Message-ID:
Pine.LNX.4.33.0311041340410.9104-100000@css120.ihs.com (view raw or flat )
Thread:
2003-10-31 02:40:33 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 05:16:40 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-10-31 05:53:14 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 16:11:53 from "Stephen" <jleelim(at)xxxxxx(dot)com>
2003-10-31 19:07:01 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 21:20:42 from "Stephen" <jleelim(at)xxxxxx(dot)com>
2003-11-01 19:12:49 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-02 05:45:08 from "Stephen" <jleelim(at)xxxxxxx(dot)com>
2003-11-02 21:20:50 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2003-11-03 15:04:52 from "Stephen" <jleelim(at)xxxxxxx(dot)com>
2003-11-03 00:15:07 from Christopher Browne <cbbrowne(at)acm(dot)org>
2003-11-03 08:24:48 from Hannu Krosing <hannu(at)tm(dot)ee>
2003-11-03 13:22:45 from Christopher Browne <cbbrowne(at)acm(dot)org>
2003-11-03 14:35:57 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-03 14:57:54 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-11-03 16:32:49 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-11-03 19:25:23 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2003-11-03 20:13:25 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-11-03 20:36:57 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2003-11-04 17:32:29 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-11-04 18:24:12 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-03 16:27:15 from Hannu Krosing <hannu(at)tm(dot)ee>
2003-11-04 04:07:55 from Ang Chin Han <angch(at)bytecraft(dot)com(dot)my>
2003-11-04 04:28:25 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 15:31:39 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 15:45:22 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 15:58:46 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 16:28:10 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 16:49:03 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 21:53:32 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 04:31:39 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 13:46:36 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 14:23:37 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 15:18:38 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 19:00:36 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 19:10:15 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-10 19:20:40 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 20:36:36 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 04:34:16 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-04 15:51:02 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2003-11-04 17:11:16 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 18:28:58 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-04 21:10:53 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-05 01:26:02 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-05 06:00:22 from Manfred Spraul <manfred(at)colorfullife(dot)com>
2003-11-05 06:06:09 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-05 15:09:01 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-10 04:07:12 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 14:18:31 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 14:25:49 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 15:05:04 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:57:01 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 18:57:56 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 19:24:48 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 19:34:24 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 21:16:38 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 22:22:55 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 14:26:38 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-10 15:31:10 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:51:59 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-04 20:41:30 from "scott(dot)marlowe" <scott(dot)marlowe(at)ihs(dot)com>
2003-11-04 21:17:39 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2003-11-10 04:18:33 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 14:25:53 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:45:23 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-11 01:33:44 from Tatsuo Ishii <t-ishii(at)sra(dot)co(dot)jp>
2003-11-10 04:14:20 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 04:54:25 from Joe Conway <mail(at)joeconway(dot)com>
2003-11-10 18:51:54 from Andrew Sullivan <andrew(at)libertyrms(dot)info>
2003-11-11 00:16:12 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 17:52:13 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-04 16:30:40 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-11-01 22:42:45 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-02 18:00:35 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-02 22:51:24 from Hannu Krosing <hannu(at)tm(dot)ee>
2003-11-03 14:48:45 from Andrew Sullivan <andrew(at)libertyrms(dot)info>
2003-11-03 15:47:04 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-10 04:48:49 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 05:00:06 from Joe Conway <mail(at)joeconway(dot)com>
2003-11-10 14:35:18 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:52:34 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 19:20:07 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-11 06:19:54 from Shridhar Daithankar <shridhar_daithankar(at)myrealbox(dot)com>
2003-11-11 13:25:07 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-11 13:34:00 from Shridhar Daithankar <shridhar_daithankar(at)myrealbox(dot)com>
2003-11-11 16:17:59 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-11 17:20:47 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-12 05:17:45 from Shridhar Daithankar <shridhar_daithankar(at)myrealbox(dot)com>
2003-11-10 16:40:45 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-10 17:57:35 from Larry Rosenman <ler(at)lerctr(dot)org>
2003-11-10 18:40:24 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-10 19:05:22 from Larry Rosenman <ler(at)lerctr(dot)org>
2003-11-05 17:24:56 from "Stephen" <jleelim(at)xxxxxxx(dot)com>
2003-10-31 22:19:51 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-10-31 16:42:20 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-10-31 17:05:06 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 17:22:50 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-10-31 17:54:11 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-10-31 20:54:16 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-03 01:08:18 from Gaetano Mendola <mendola(at)bigfoot(dot)com>
Lists:
pgsql-hackers
On Tue, 4 Nov 2003, Tom Lane wrote:
> Jan Wieck <JanWieck(at)Yahoo(dot)com> writes:
> > What still needs to be addressed is the IO storm cause by checkpoints. I
> > see it much relaxed when stretching out the BufferSync() over most of
> > the time until the next one should occur. But the kernel sync at it's
> > end still pushes the system hard against the wall.
>
> I have never been happy with the fact that we use sync(2) at all. Quite
> aside from the "I/O storm" issue, sync() is really an unsafe way to do a
> checkpoint, because there is no way to be certain when it is done. And
> on top of that, it does too much, because it forces syncing of files
> unrelated to Postgres.
>
> I would like to see us go over to fsync, or some other technique that
> gives more certainty about when the write has occurred. There might be
> some scope that way to allow stretching out the I/O, too.
>
> The main problem with this is knowing which files need to be fsync'd.
Wasn't this a problem that the win32 port had to solve by keeping a list
of all files that need fsyncing since Windows doesn't do sync() in the
classical sense? If so, then could we use that code to keep track of the
files that need fsyncing?
In response to
Responses
pgsql-hackers by date
Next :From: Marc G. FournierDate: 2003-11-04 20:59:57
Subject : Re: Open Sourcing pgManage
Previous :From : Jan WieckDate : 2003-11-04 20:39:51
Subject : Re: Experimental ARC implementation