From:
Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
To:
pgsql-hackers(at)postgresql(dot)org
Cc:
Bruce Momjian <bruce(at)momjian(dot)us>, David Fetter <david(at)fetter(dot)org>,
Josh Berkus <josh(at)agliodbs(dot)com>, Marko Kreen <markokr(at)gmail(dot)com>,
Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Subject:
Re: Core team statement on replication in PostgreSQL
Date:
2008-05-29 21:42:16
Message-ID:
200805291742.17495.xzilla@users.sourceforge.net (view raw or flat )
Thread:
2008-05-29 14:12:55 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 14:54:03 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-05-29 15:58:19 from Rick Vernam <rickv(at)hobi(dot)com>
2008-05-29 18:49:14 from Teodor Sigaev <teodor(at)sigaev(dot)ru>
2008-05-29 19:22:09 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-05-29 15:21:05 from David Fetter <david(at)fetter(dot)org>
2008-05-29 15:40:57 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-05-29 15:49:54 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-29 15:58:31 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-05-29 16:12:02 from David Fetter <david(at)fetter(dot)org>
2008-05-29 16:13:20 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-05-29 21:42:16 from Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
2008-05-29 21:52:37 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 21:54:36 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-29 22:39:53 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2008-05-29 22:47:05 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-29 23:02:56 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 23:12:22 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-30 00:14:30 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-30 00:57:21 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2008-05-30 01:25:49 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-30 00:25:10 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-05-30 00:31:31 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-05-30 01:26:36 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-30 02:59:21 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-05-30 19:16:57 from Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
2008-05-30 03:02:56 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2008-05-30 14:19:00 from Andreas 'ads' Scherbaum <adsmail(at)wars-nicht(dot)de>
2008-05-30 20:22:41 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-05-30 21:18:51 from "Gurjeet Singh" <singh(dot)gurjeet(at)gmail(dot)com>
2008-05-30 22:11:20 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-05-31 03:39:14 from "Gurjeet Singh" <singh(dot)gurjeet(at)gmail(dot)com>
2008-05-31 00:00:17 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-30 22:42:20 from Andreas 'ads' Scherbaum <adsmail(at)wars-nicht(dot)de>
2008-06-10 01:46:06 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-06-10 01:49:52 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2008-06-10 01:55:31 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-06-10 02:48:33 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-06-10 03:16:11 from "Koichi Suzuki" <koichi(dot)szk(at)gmail(dot)com>
2008-06-10 09:43:51 from Gregory Stark <stark(at)enterprisedb(dot)com>
2008-06-10 10:03:08 from "Heikki Linnakangas" <heikki(at)enterprisedb(dot)com>
2008-06-16 16:56:51 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2008-07-10 00:55:25 from Robert Hodges <robert(dot)hodges(at)continuent(dot)com>
2008-07-10 11:56:31 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-07-10 14:44:20 from Robert Hodges <robert(dot)hodges(at)continuent(dot)com>
2008-07-11 21:03:14 from chris <cbbrowne(at)ca(dot)afilias(dot)info>
2008-07-15 15:03:55 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-07-15 22:18:46 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2008-07-15 22:24:17 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-07-15 22:32:08 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2008-07-15 22:56:31 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-05-30 21:05:57 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2008-05-30 22:47:19 from Andreas 'ads' Scherbaum <adsmail(at)wars-nicht(dot)de>
2008-05-31 06:18:08 from "Mike Rylander" <mrylander(at)gmail(dot)com>
2008-05-31 14:21:41 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-05-31 15:14:48 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-30 22:51:57 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-31 00:56:19 from Tatsuo Ishii <ishii(at)postgresql(dot)org>
2008-05-31 01:32:26 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2008-06-02 15:52:05 from Chris Browne <cbbrowne(at)acm(dot)org>
2008-06-02 20:40:47 from Andreas 'ads' Scherbaum <adsmail(at)wars-nicht(dot)de>
2008-06-03 07:19:59 from Hannu Krosing <hannu(at)krosing(dot)net>
2008-05-30 05:10:20 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-30 07:01:46 from "Gurjeet Singh" <singh(dot)gurjeet(at)gmail(dot)com>
2008-05-30 13:31:06 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-05-30 15:59:23 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-05-30 14:43:00 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-05-30 14:46:19 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-30 15:30:14 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2008-05-30 15:58:03 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-06-10 01:25:17 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-06-10 01:50:58 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-06-10 16:01:05 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-06-11 01:11:07 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2008-05-30 08:56:45 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-05-30 19:16:29 from Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
2008-06-01 20:42:11 from Hannu Krosing <hannu(at)krosing(dot)net>
2008-06-04 04:08:46 from "Stephen Denne" <Stephen(dot)Denne(at)datamail(dot)co(dot)nz>
2008-06-04 08:13:52 from "Heikki Linnakangas" <heikki(at)enterprisedb(dot)com>
2008-06-04 10:51:26 from Teodor Sigaev <teodor(at)sigaev(dot)ru>
2008-06-04 11:19:42 from "Heikki Linnakangas" <heikki(at)enterprisedb(dot)com>
2008-06-04 10:58:53 from Csaba Nagy <nagy(at)ecircle-ag(dot)com>
2008-06-04 11:17:55 from "Heikki Linnakangas" <heikki(at)enterprisedb(dot)com>
2008-06-04 17:18:17 from Jeff Davis <pgsql(at)j-davis(dot)com>
2008-06-04 18:23:38 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-06-04 18:26:02 from Jeff Davis <pgsql(at)j-davis(dot)com>
2008-06-05 11:08:14 from Gregory Stark <stark(at)enterprisedb(dot)com>
2008-06-04 14:40:58 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-06-04 15:27:04 from Hannu Krosing <hannu(at)krosing(dot)net>
2008-06-04 15:37:25 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-06-04 16:16:40 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-06-05 00:10:26 from "Koichi Suzuki" <koichi(dot)szk(at)gmail(dot)com>
2008-06-05 00:30:34 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-06-05 04:21:25 from "Koichi Suzuki" <koichi(dot)szk(at)gmail(dot)com>
2008-05-30 19:16:34 from Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
2008-05-30 02:38:28 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-05-29 22:12:31 from Dimitri Fontaine <dim(at)hi-media(dot)com>
2008-05-29 22:29:01 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-30 08:29:30 from Dimitri Fontaine <dfontaine(at)hi-media(dot)com>
2008-05-30 09:02:03 from Dimitri Fontaine <dfontaine(at)hi-media(dot)com>
2008-05-30 14:26:53 from Andreas 'ads' Scherbaum <adsmail(at)wars-nicht(dot)de>
2008-05-29 16:22:26 from Steve Atkins <steve(at)blighty(dot)com>
2008-05-30 14:42:10 from Andreas 'ads' Scherbaum <adsmail(at)wars-nicht(dot)de>
2008-05-29 19:54:03 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2008-05-29 20:39:29 from David Fetter <david(at)fetter(dot)org>
2008-05-29 20:44:19 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 20:50:51 from David Fetter <david(at)fetter(dot)org>
2008-05-29 20:54:04 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-05-29 20:58:34 from David Fetter <david(at)fetter(dot)org>
2008-05-30 13:29:03 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-05-29 21:00:29 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 20:55:42 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-29 21:02:08 from David Fetter <david(at)fetter(dot)org>
2008-05-29 21:09:28 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-29 21:29:01 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-05-29 16:18:44 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-29 16:20:55 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-05-29 17:41:32 from Jeff Davis <pgsql(at)j-davis(dot)com>
2008-05-29 19:56:12 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2008-05-29 16:10:05 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2008-05-29 15:46:22 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-29 15:48:25 from "Douglas McNaught" <doug(at)mcnaught(dot)org>
2008-05-29 16:00:55 from "Dave Page" <dpage(at)pgadmin(dot)org>
2008-05-29 16:16:15 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2008-05-29 16:27:38 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-05-29 16:35:41 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2008-06-01 20:16:51 from James Mansion <james(at)mansionfamily(dot)plus(dot)com>
2008-05-29 16:19:48 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2008-05-29 16:40:14 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 19:03:40 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-05-29 19:59:55 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2008-05-29 20:22:13 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-05-29 15:53:03 from David Fetter <david(at)fetter(dot)org>
2008-05-29 17:37:14 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 19:05:18 from Robert Hodges <robert(dot)hodges(at)continuent(dot)com>
2008-05-29 19:16:57 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-06-01 15:58:59 from Robert Hodges <robert(dot)hodges(at)continuent(dot)com>
2008-06-01 17:19:10 from "Merlin Moncure" <mmoncure(at)gmail(dot)com>
2008-06-01 17:43:22 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-06-04 03:20:11 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-06-04 07:24:20 from Markus Schiltknecht <markus(at)bluegap(dot)ch>
2008-06-04 14:36:23 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-05-29 19:30:07 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-05-29 20:09:47 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-05-29 22:06:39 from Chris Browne <cbbrowne(at)acm(dot)org>
2008-05-30 18:12:51 from Robert Hodges <robert(dot)hodges(at)continuent(dot)com>
2008-05-30 19:57:28 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-05-29 20:35:41 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-06-01 21:14:39 from Hannu Krosing <hannu(at)krosing(dot)net>
2008-06-02 06:37:30 from Robert Hodges <robert(dot)hodges(at)continuent(dot)com>
2008-05-29 19:33:41 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-06-01 20:42:29 from Hannu Krosing <hannu(at)krosing(dot)net>
2008-05-29 16:10:26 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-29 16:29:58 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2008-05-29 18:05:12 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-05-29 20:08:11 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2008-05-29 16:20:37 from "Marko Kreen" <markokr(at)gmail(dot)com>
2008-05-29 18:20:04 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-05-29 20:10:13 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2008-05-29 16:11:21 from Brian Hurt <bhurt(at)janestcapital(dot)com>
2008-05-29 18:13:26 from Andrew Sullivan <ajs(at)commandprompt(dot)com>
2008-05-29 18:28:08 from David Fetter <david(at)fetter(dot)org>
2008-05-29 19:21:24 from Brian Hurt <bhurt(at)janestcapital(dot)com>
2008-05-29 17:11:08 from Shane Ambler <pgsql(at)Sheeky(dot)Biz>
2008-05-29 17:39:48 from Greg Smith <gsmith(at)gregsmith(dot)com>
2008-06-01 19:57:00 from James Mansion <james(at)mansionfamily(dot)plus(dot)com>
2008-05-29 16:01:44 from Mathias Brossard <mathias(dot)brossard(at)opentrust(dot)com>
2008-05-29 20:12:54 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2008-05-29 21:37:44 from Mathias Brossard <mathias(dot)brossard(at)opentrust(dot)com>
2008-06-02 17:37:59 from Hannu Krosing <hannu(at)krosing(dot)net>
2008-05-29 20:14:14 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2008-05-30 08:29:17 from Simon Riggs <simon(at)2ndquadrant(dot)com>
2008-05-30 10:21:53 from Dirk Riehle <dirk(at)riehle(dot)org>
2008-05-31 18:48:26 from Josh Berkus <josh(at)agliodbs(dot)com>
2008-06-01 03:22:23 from Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
2008-06-01 13:31:44 from Dirk Riehle <dirk(at)riehle(dot)org>
2008-06-01 05:23:21 from Shane Ambler <pgsql(at)Sheeky(dot)Biz>
2008-06-01 14:56:10 from "Jonah H(dot) Harris" <jonah(dot)harris(at)gmail(dot)com>
2008-05-30 20:21:28 from "Gurjeet Singh" <singh(dot)gurjeet(at)gmail(dot)com>
2008-06-01 18:31:13 from "Dawid Kuroczko" <qnex42(at)gmail(dot)com>
Lists:
pgsql-advocacy pgsql-hackers
On Thursday 29 May 2008 12:13:20 Bruce Momjian wrote:
> David Fetter wrote:
> > On Thu, May 29, 2008 at 11:58:31AM -0400, Bruce Momjian wrote:
> > > Josh Berkus wrote:
> > > > Publishing the XIDs back to the master is one possibility. We
> > > > also looked at using "spillover segments" for vacuumed rows, but
> > > > that seemed even less viable.
> > > >
> > > > I'm also thinking, for *async replication*, that we could simply
> > > > halt replication on the slave whenever a transaction passes minxid
> > > > on the master. However, the main focus will be on synchrounous
> > > > hot standby.
> > >
> > > Another idea I discussed with Tom is having the slave _delay_
> > > applying WAL files until all slave snapshots are ready.
> >
> > Either one of these would be great, but something that involves
> > machines that stay useless most of the time is just not going to work.
>
> Right, the ultimate target is to have the slave be read-only, but we
> need to get the streaming of WAL logs done first.
>
I would have thought the read only piece would have been more important than
the synchronous piece. In my experience readable slaves is the big selling
point in both Oracle and MySQL's implementations, and people are not nearly
as concerned if there is a small asynchronous window.
It would also be easier to implement on some level; we have already solved the
asynchronus wal shipping problem, so we would just need to solve the
read-only bits. For synchronus hot standby, you have to solve both the
synchronus shipping and the read-only bits. Seems like more work with less
upside that read-only slaves vs. pitr warm standby we have now.
Interesting that core views this differently.
--
Robert Treat
Build A Brighter LAMP :: Linux Apache {middleware} PostgreSQL
In response to
Responses
pgsql-hackers by date
Next :From: MikeDate: 2008-05-29 21:43:32
Subject : Re: intercepting WAL writes
Previous :From : Mathias BrossardDate : 2008-05-29 21:37:44
Subject : Re: Core team statement on replication in PostgreSQL
pgsql-advocacy by date
Next :From: Tom LaneDate: 2008-05-29 21:52:37
Subject : Re: Core team statement on replication in PostgreSQL
Previous :From : Mathias BrossardDate : 2008-05-29 21:37:44
Subject : Re: Core team statement on replication in PostgreSQL