Re: Experimental patch for inter-page delay in VACUUM
From:
Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To:
Jan Wieck <JanWieck(at)Yahoo(dot)com>
Cc:
pgsql-hackers(at)postgresql(dot)org
Subject:
Re: Experimental patch for inter-page delay in VACUUM
Date:
2003-11-02 18:00:35
Message-ID:
15456.1067796035@sss.pgh.pa.us (view raw or flat )
Thread:
2003-10-31 02:40:33 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 05:16:40 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-10-31 05:53:14 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 16:11:53 from "Stephen" <jleelim(at)xxxxxx(dot)com>
2003-10-31 19:07:01 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 21:20:42 from "Stephen" <jleelim(at)xxxxxx(dot)com>
2003-11-01 19:12:49 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-02 05:45:08 from "Stephen" <jleelim(at)xxxxxxx(dot)com>
2003-11-02 21:20:50 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2003-11-03 15:04:52 from "Stephen" <jleelim(at)xxxxxxx(dot)com>
2003-11-03 00:15:07 from Christopher Browne <cbbrowne(at)acm(dot)org>
2003-11-03 08:24:48 from Hannu Krosing <hannu(at)tm(dot)ee>
2003-11-03 13:22:45 from Christopher Browne <cbbrowne(at)acm(dot)org>
2003-11-03 14:35:57 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-03 14:57:54 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-11-03 16:32:49 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-11-03 19:25:23 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2003-11-03 20:13:25 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-11-03 20:36:57 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2003-11-04 17:32:29 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-11-04 18:24:12 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-03 16:27:15 from Hannu Krosing <hannu(at)tm(dot)ee>
2003-11-04 04:07:55 from Ang Chin Han <angch(at)bytecraft(dot)com(dot)my>
2003-11-04 04:28:25 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 15:31:39 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 15:45:22 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 15:58:46 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 16:28:10 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 16:49:03 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 21:53:32 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 04:31:39 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 13:46:36 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 14:23:37 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 15:18:38 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 19:00:36 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 19:10:15 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-10 19:20:40 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 20:36:36 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 04:34:16 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-04 15:51:02 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2003-11-04 17:11:16 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-04 18:28:58 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-04 21:10:53 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-05 01:26:02 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-05 06:00:22 from Manfred Spraul <manfred(at)colorfullife(dot)com>
2003-11-05 06:06:09 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-05 15:09:01 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-10 04:07:12 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 14:18:31 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 14:25:49 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 15:05:04 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:57:01 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 18:57:56 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 19:24:48 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 19:34:24 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 21:16:38 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 22:22:55 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 14:26:38 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-10 15:31:10 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:51:59 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-04 20:41:30 from "scott(dot)marlowe" <scott(dot)marlowe(at)ihs(dot)com>
2003-11-04 21:17:39 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2003-11-10 04:18:33 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 14:25:53 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:45:23 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-11 01:33:44 from Tatsuo Ishii <t-ishii(at)sra(dot)co(dot)jp>
2003-11-10 04:14:20 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 04:54:25 from Joe Conway <mail(at)joeconway(dot)com>
2003-11-10 18:51:54 from Andrew Sullivan <andrew(at)libertyrms(dot)info>
2003-11-11 00:16:12 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-04 17:52:13 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-04 16:30:40 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-11-01 22:42:45 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-02 18:00:35 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-02 22:51:24 from Hannu Krosing <hannu(at)tm(dot)ee>
2003-11-03 14:48:45 from Andrew Sullivan <andrew(at)libertyrms(dot)info>
2003-11-03 15:47:04 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-10 04:48:49 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 05:00:06 from Joe Conway <mail(at)joeconway(dot)com>
2003-11-10 14:35:18 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-10 18:52:34 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-11-10 19:20:07 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-11 06:19:54 from Shridhar Daithankar <shridhar_daithankar(at)myrealbox(dot)com>
2003-11-11 13:25:07 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-11 13:34:00 from Shridhar Daithankar <shridhar_daithankar(at)myrealbox(dot)com>
2003-11-11 16:17:59 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-11-11 17:20:47 from Greg Stark <gsstark(at)mit(dot)edu>
2003-11-12 05:17:45 from Shridhar Daithankar <shridhar_daithankar(at)myrealbox(dot)com>
2003-11-10 16:40:45 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-10 17:57:35 from Larry Rosenman <ler(at)lerctr(dot)org>
2003-11-10 18:40:24 from Neil Conway <neilc(at)samurai(dot)com>
2003-11-10 19:05:22 from Larry Rosenman <ler(at)lerctr(dot)org>
2003-11-05 17:24:56 from "Stephen" <jleelim(at)xxxxxxx(dot)com>
2003-10-31 22:19:51 from "Matthew T(dot) O'Connor" <matthew(at)zeut(dot)net>
2003-10-31 16:42:20 from Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
2003-10-31 17:05:06 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-10-31 17:22:50 from Jan Wieck <JanWieck(at)Yahoo(dot)com>
2003-10-31 17:54:11 from Christopher Browne <cbbrowne(at)libertyrms(dot)info>
2003-10-31 20:54:16 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2003-11-03 01:08:18 from Gaetano Mendola <mendola(at)bigfoot(dot)com>
Lists:
pgsql-hackers
Jan Wieck <JanWieck(at)Yahoo(dot)com> writes:
> I am currently looking at implementing ARC as a replacement strategy. I
> don't have anything that works yet, so I can't really tell what the
> result would be and it might turn out that we want both features.
It's likely that we would. As someone (you?) already pointed out,
VACUUM has bad side-effects both in terms of cache flushing and in
terms of sheer I/O load. Those effects require different fixes AFAICS.
One thing that bothers me here is that I don't see how adjusting our
own buffer replacement strategy is going to do much of anything when
we cannot control the kernel's buffer replacement strategy. To get any
real traction we'd have to go back to the "take over most of RAM for
shared buffers" approach, which we already know to have a bunch of
severe disadvantages.
regards, tom lane
In response to
Responses
pgsql-hackers by date
Next :From: AgentMDate: 2003-11-02 20:32:51Subject : Re: Avoiding SIGPIPE (was Re: OSDL DBT-2 w/ PostgreSQL Previous :From : Jon PastoreDate : 2003-11-02 17:44:20Subject : suggestion for error statements
