From:
Andres Freund <andres(at)anarazel(dot)de>
To:
david(at)lang(dot)hm
Cc:
Greg Stark <gsstark(at)mit(dot)edu>,
pgsql-performance(at)postgresql(dot)org,
pgsql-hackers(at)postgresql(dot)org,
Michael Clemmons <glassresistor(at)gmail(dot)com>,
Hannu Krosing <hannu(at)2ndquadrant(dot)com>,
Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
Subject:
Re: Re: Faster CREATE DATABASE by delaying fsync (was 8.4.1 ubuntu karmic slow createdb)
Date:
2009-12-29 00:43:15
Message-ID:
200912290143.15866.andres@anarazel.de (view raw or flat )
Thread:
2009-12-10 20:41:08 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-10 21:56:59 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-10 22:01:08 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-10 22:09:03 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-11 01:38:25 from Nikolas Everett <nik9000(at)gmail(dot)com>
2009-12-11 17:58:39 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2009-12-11 20:43:59 from Nikolas Everett <nik9000(at)gmail(dot)com>
2009-12-11 20:50:10 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2009-12-11 21:39:34 from Nikolas Everett <nik9000(at)gmail(dot)com>
2009-12-11 21:57:56 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-11 22:12:45 from Scott Carey <scott(at)richrelevance(dot)com>
2009-12-11 22:19:05 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-11 21:59:43 from Scott Mead <scott(dot)lists(at)enterprisedb(dot)com>
2009-12-11 22:12:47 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-13 03:56:42 from Robert Haas <robertmhaas(at)gmail(dot)com>
2009-12-11 22:39:54 from Greg Smith <greg(at)2ndquadrant(dot)com>
2009-12-11 22:52:01 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-11 23:59:13 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-12 00:19:38 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-12 20:36:27 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-12 20:38:41 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 22:54:51 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 22:59:43 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 18:30:49 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-18 16:35:59 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-19 14:52:25 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-19 14:57:14 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-20 04:13:03 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-20 05:21:07 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-01-27 07:21:44 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-01-19 15:03:16 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-19 15:25:46 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-01-29 18:56:23 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-02 17:36:12 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-02 17:43:15 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-02 17:50:15 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-02 18:14:40 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-02 18:34:07 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-02 19:06:32 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-02 19:08:12 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-02 19:33:30 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-02 19:45:46 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-03 11:53:58 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-03 12:03:04 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-03 13:42:57 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-03 14:19:49 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-06 05:03:30 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-02-06 12:03:50 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-07 05:13:15 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-07 09:23:14 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-02-07 16:24:00 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-07 18:23:10 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-07 18:27:02 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-08 01:31:42 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-08 03:09:01 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2010-02-08 04:53:23 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-08 07:13:41 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-08 18:34:01 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-08 19:29:46 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-11 02:27:30 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-12 15:49:16 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-14 14:03:44 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-14 15:31:58 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-14 17:11:39 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-14 17:27:00 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-14 17:37:15 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-14 20:24:24 from Florian Weimer <fw(at)deneb(dot)enyo(dot)de>
2010-02-14 20:41:02 from Mark Mielke <mark(at)mark(dot)mielke(dot)cc>
2010-02-14 20:49:09 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-15 00:08:10 from Mark Mielke <mark(at)mark(dot)mielke(dot)cc>
2010-02-14 20:57:08 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-14 21:43:23 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-14 23:33:54 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-20 04:02:17 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-20 04:01:55 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 23:06:28 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2009-12-28 23:20:35 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:46:21 from Greg Smith <greg(at)2ndquadrant(dot)com>
2009-12-29 02:05:39 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 02:53:12 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-29 02:55:37 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 03:04:06 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-29 03:11:14 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 10:48:10 from Greg Stark <gsstark(at)mit(dot)edu>
2009-12-29 11:13:21 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 23:31:56 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:27:29 from Greg Stark <gsstark(at)mit(dot)edu>
2009-12-29 00:29:34 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:30:17 from david(at)lang(dot)hm
2009-12-29 00:43:15 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:46:26 from david(at)lang(dot)hm
2009-12-28 23:57:42 from Thomas Kellerer <spam_eater(at)gmx(dot)net>
Lists:
pgsql-hackers pgsql-performance
On Tuesday 29 December 2009 01:30:17 david(at)lang(dot)hm wrote:
> On Tue, 29 Dec 2009, Greg Stark wrote:
> > On Mon, Dec 28, 2009 at 10:54 PM, Andres Freund <andres(at)anarazel(dot)de>
wrote:
> >> fsync everything in that pass.
> >> Including the directory - which was not done before and actually might
> >> be necessary in some cases.
> >
> > Er. Yes. At least on ext4 this is pretty important. I wish it weren't,
> > but it doesn't look like we're going to convince the ext4 developers
> > they're crazy any day soon and it would really suck for a database
> > created from a template to have files in it go missin.
>
> actually, as I understand it you need to do this on all filesystems except
> ext3, and on ext3 fsync is horribly slow because it writes out
> _everything_ that's pending, not just stuff related to the file you do the
> fsync on.
I dont think its all filesystems (ext2 should not be affected...), but generally
youre right. At least jfs, xfs are affected as well.
Its btw not necessarily nearly-safe and slow on ext3 as well (data=writeback).
Andres
In response to
Responses
pgsql-performance by date
Next :From: Greg SmithDate: 2009-12-29 00:46:21Subject : Re: [HACKERS] Faster CREATE DATABASE by delaying fsync
(was 8.4.1 ubuntu karmic slow createdb)Previous :From : davidDate : 2009-12-29 00:30:17Subject : Re: Re: Faster CREATE DATABASE by delaying fsync (was
8.4.1 ubuntu karmic slow createdb)
pgsql-hackers by date
Next :From: Greg SmithDate: 2009-12-29 00:46:21Subject : Re: [HACKERS] Faster CREATE DATABASE by delaying fsync
(was 8.4.1 ubuntu karmic slow createdb)Previous :From : Kevin GrittnerDate : 2009-12-29 00:42:50Subject : Re: Serializable implementation
