From:
Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
To:
Boszormenyi Zoltan <zb(at)cybertec(dot)at>
Cc:
Hari Babu <haribabu(dot)kommi(at)huawei(dot)com>,
'Fujii Masao' <masao(dot)fujii(at)gmail(dot)com>,
pgsql-hackers(at)postgresql(dot)org, 'Amit kapila' <amit(dot)kapila(at)huawei(dot)com>
Subject:
Re: Review of "pg_basebackup and pg_receivexlog to use non-blocking
socket communication", was: Re: Re: [BUGS] BUG #7534: walreceiver
takes long time to detect n/w breakdown
Date:
2013-01-16 10:31:54
Message-ID:
50F6819A.8020000@vmware.com (view raw or flat )
Thread:
2012-09-12 11:54:59 from amit(dot)kapila(at)huawei(dot)com
2012-09-12 16:41:44 from Magnus Hagander <magnus(at)hagander(dot)net>
2012-09-13 04:00:24 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-09-12 16:45:05 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-09-13 04:22:08 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-09-13 17:27:52 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-09-14 13:01:37 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-09-15 05:57:12 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-09-15 07:26:05 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-09-15 18:44:19 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-09-16 06:10:43 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-09-17 07:03:28 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-09-18 12:32:43 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-09-18 12:50:33 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-09-21 11:18:01 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-01 10:38:49 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-10-01 15:06:12 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-10-02 07:43:50 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-01 16:57:34 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-10-02 00:02:54 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-10-02 03:50:42 from Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>
2012-10-02 07:36:39 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-02 08:26:24 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-10-04 10:12:30 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-04 12:27:52 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-08 14:08:00 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-10-08 14:42:23 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-09 12:29:52 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-10-09 13:04:31 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-10 15:44:34 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-10-11 10:17:11 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-11 14:52:40 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-10-11 15:52:25 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-13 16:35:12 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-10-15 10:13:01 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-10-15 14:27:56 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-10-15 16:31:09 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-10-16 12:31:08 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-10-18 16:48:31 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-11-07 17:22:04 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-11-08 16:40:47 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-11-08 16:56:41 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-10-17 11:46:04 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-17 13:07:30 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-10-18 15:19:30 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-10-19 11:42:16 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-11-08 08:33:42 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2012-11-08 08:53:53 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-11-08 17:12:14 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-11-09 06:03:32 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2012-11-12 14:53:58 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-11-13 04:06:51 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-11-13 16:02:05 from Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
2012-11-15 13:59:12 from Amit kapila <amit(dot)kapila(at)huawei(dot)com>
2012-11-16 11:40:03 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2013-01-01 16:48:48 from Boszormenyi Zoltan <zb(at)cybertec(dot)at>
2013-01-02 07:11:15 from Hari Babu <haribabu(dot)kommi(at)huawei(dot)com>
2013-01-04 12:43:08 from Hari Babu <haribabu(dot)kommi(at)huawei(dot)com>
2013-01-07 14:23:02 from Boszormenyi Zoltan <zb(at)cybertec(dot)at>
2013-01-09 04:02:58 from Hari Babu <haribabu(dot)kommi(at)huawei(dot)com>
2013-01-16 07:48:17 from Abhijit Menon-Sen <ams(at)2ndQuadrant(dot)com>
2013-01-16 10:31:54 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2013-01-18 06:50:58 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2013-01-18 10:15:53 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2013-01-18 11:41:36 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2013-01-18 12:05:05 from Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>
2013-01-18 13:24:54 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2013-01-19 12:19:28 from Magnus Hagander <magnus(at)hagander(dot)net>
2013-01-22 09:56:44 from Hari Babu <haribabu(dot)kommi(at)huawei(dot)com>
2013-01-24 15:13:50 from Hari Babu <haribabu(dot)kommi(at)huawei(dot)com>
2013-01-18 13:43:08 from Dimitri Fontaine <dimitri(at)2ndQuadrant(dot)fr>
2013-01-19 12:20:23 from Magnus Hagander <magnus(at)hagander(dot)net>
2013-01-19 17:05:02 from Dimitri Fontaine <dimitri(at)2ndQuadrant(dot)fr>
2013-01-19 17:33:23 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2013-01-19 20:06:37 from Dimitri Fontaine <dimitri(at)2ndQuadrant(dot)fr>
2013-01-20 16:45:31 from Robert Haas <robertmhaas(at)gmail(dot)com>
2013-01-21 12:51:44 from Magnus Hagander <magnus(at)hagander(dot)net>
2013-01-22 06:31:14 from Amit Kapila <amit(dot)kapila(at)huawei(dot)com>
2013-01-28 09:45:10 from Magnus Hagander <magnus(at)hagander(dot)net>
Lists:
pgsql-bugs pgsql-hackers
On 07.01.2013 16:23, Boszormenyi Zoltan wrote:
> Since my other patch against pg_basebackup is now committed,
> this patch doesn't apply cleanly, patch rejects 2 hunks.
> The fixed up patch is attached.
Now that I look at this a high-level perspective, why are we only
worried about timeouts in the Copy-mode and when connecting? The initial
checkpoint could take a long time too, and if the server turns into a
black hole while the checkpoint is running, pg_basebackup will still
hang. Then again, a short timeout on that phase would be a bad idea,
because the checkpoint can indeed take a long time.
In streaming replication, the keep-alive messages carry additional
information, the timestamps and WAL locations, so a keepalive makes
sense at that level. But otherwise, aren't we just trying to reimplement
TCP keepalives? TCP keepalives are not perfect, but if we want to have
an application level timeout, it should be implemented in the FE/BE
protocol.
I don't think we need to do anything specific to pg_basebackup. The user
can simply specify TCP keepalive settings in the connection string, like
with any libpq program.
- Heikki
In response to
Responses
pgsql-hackers by date
Next :From: Magnus HaganderDate: 2013-01-16 11:52:43Subject : Re: Parallel query executionPrevious :From : Kohei KaiGaiDate : 2013-01-16 09:43:23Subject : Re: system administration functions with hardcoded
superuser checks
pgsql-bugs by date
Next :From: tsunezumiDate: 2013-01-17 11:07:05Subject : BUG #7814: Rotation of the log is not carried out. Previous :From : Abhijit Menon-SenDate : 2013-01-16 07:48:17Subject : Re: Review of "pg_basebackup and pg_receivexlog to use non-blocking
socket communication", was: Re: Re: [BUGS] BUG #7534: walreceiver takes long
time to detect n/w breakdown
