From:
Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
To:
Aidan Van Dyk <aidan(at)highrise(dot)ca>
Cc:
Simon Riggs <simon(at)2ndQuadrant(dot)com>,
Fujii Masao <masao(dot)fujii(at)gmail(dot)com>,
PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject:
Re: Re: [COMMITTERS] pgsql: Make standby server continuously
retry restoring the next WAL
Date:
2010-02-11 17:04:41
Message-ID:
4B7438A9.8090902@enterprisedb.com (view raw or flat )
Thread:
2010-01-27 15:27:51 from heikki(at)postgresql(dot)org (Heikki Linnakangas)
2010-02-10 05:05:55 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-02-10 07:32:48 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-10 09:19:01 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-02-10 13:45:00 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2010-02-10 16:53:34 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 10:37:37 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-11 12:22:16 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 12:27:28 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-11 12:44:09 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 13:06:39 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-11 13:28:51 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 13:46:56 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-11 14:01:18 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2010-02-11 14:17:48 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 14:42:04 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2010-02-11 17:04:41 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 17:31:54 from Aidan Van Dyk <aidan(at)highrise(dot)ca>
2010-02-11 18:11:38 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 18:22:44 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2010-02-11 19:45:13 from Garick Hamlin <ghamlin(at)isc(dot)upenn(dot)edu>
2010-02-11 18:08:24 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-11 18:14:12 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-12 07:37:40 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 17:29:33 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 18:11:01 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-18 11:37:18 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-17 10:35:37 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-17 10:49:11 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-18 14:27:59 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-19 08:52:04 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-19 11:37:08 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-19 12:43:34 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-03-19 12:50:34 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-19 13:28:48 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2010-03-19 13:44:53 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-23 07:17:53 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-24 12:31:06 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-24 13:20:45 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-24 13:36:33 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-25 12:55:42 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-25 13:43:53 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-03-26 05:24:35 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-30 16:28:28 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-31 02:01:40 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-25 12:48:27 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-24 23:23:01 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-25 02:08:06 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-03-25 02:14:37 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-03-25 08:11:45 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-25 08:23:47 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-25 10:26:25 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-25 10:47:07 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-25 19:48:06 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-25 08:08:11 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-25 10:15:15 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-03-25 19:45:22 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-25 08:22:55 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-03-25 10:05:37 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 13:41:15 from Dimitri Fontaine <dfontaine(at)hi-media(dot)com>
2010-02-11 13:50:50 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-11 13:55:56 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 14:17:14 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-11 14:22:54 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 14:38:40 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-11 15:21:13 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-11 15:29:38 from Euler Taveira de Oliveira <euler(at)timbira(dot)com>
2010-02-11 14:55:11 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-02-12 05:38:32 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-02-12 12:51:20 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-12 13:10:21 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-12 15:47:42 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-02-12 16:10:05 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-02-15 06:29:57 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2010-02-12 14:34:29 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2010-02-12 17:25:02 from Dimitri Fontaine <dfontaine(at)hi-media(dot)com>
2010-02-12 17:47:49 from Greg Stark <stark(at)mit(dot)edu>
Lists:
pgsql-committers pgsql-docs pgsql-hackers
Aidan Van Dyk wrote:
> * Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com> [100211 09:17]:
>
>> If the file is just being copied to the archive when restore_command
>> ('cp', say) is launched, it will copy a half file. That's not a problem
>> for PITR, because PITR will end at the end of valid WAL anyway, but
>> returning a half WAL file in standby mode is a problem.
>
> But it can be a problem - without the last WAL (or at least enough of
> it) the master switched and archived, you have no guarantee of having
> being consistent again (I'm thinking specifically of recovering from a
> fresh backup)
You have to wait for the last WAL file required by the backup to be
archived before starting recovery. Otherwise there's no guarantee anyway.
>> We could well just document that you should do that, ie. make sure the
>> file appears in the archive atomically with the right size.
>
> I have to admit, today was the first time I went and re-read the PITR
> docs, and no, the docs don't seem to talk about that... Maybe it was
> just plain obvious to me because it (the atomic apperance) is something
> unix devloppers have always had to deal with, so it's ingrained in me.
> But I'm *sure* that I've seen that bandied around as common knowledge on
> the lists, and one of the reasons we alway see warnings about using
> rsync instead of plain SCP, etc.
>
> So ya, we should probably mention that somewhere in the docs. Section
> 24.3.6. Caveats?
-1. it isn't necessary for PITR. It's a new requirement for
standby_mode='on', unless we add the file size check into the backend. I
think we should add the file size check to the backend instead and save
admins the headache.
--
Heikki Linnakangas
EnterpriseDB http://www.enterprisedb.com
In response to
Responses
pgsql-docs by date
Next :From: Heikki LinnakangasDate: 2010-02-11 17:29:33
Subject : Re: Re: [COMMITTERS] pgsql: Make standby server continuously
retry restoring the next WAL
Previous :From : Euler Taveira de OliveiraDate : 2010-02-11 15:29:38
Subject : Re: Re: [COMMITTERS] pgsql: Make standby server continuously
retry restoring the next WAL
pgsql-hackers by date
Next :From: Andrew DunstanDate: 2010-02-11 17:07:46
Subject : Re: a common place for pl/perlu modules
Previous :From : Peter GeogheganDate : 2010-02-11 16:43:01
Subject : Re: TCP keepalive support for libpq
pgsql-committers by date
Next :From: Heikki LinnakangasDate: 2010-02-11 17:29:33
Subject : Re: Re: [COMMITTERS] pgsql: Make standby server continuously
retry restoring the next WAL
Previous :From : Tom LaneDate : 2010-02-11 16:27:38
Subject : Re: Re: [COMMITTERS] pgsql: Remove old-style VACUUM FULL (which was known for a little while