Re: [HACKERS] Faster CREATE DATABASE by delaying fsync (was 8.4.1 ubuntu karmic slow createdb)
From:
Andres Freund <andres(at)anarazel(dot)de>
To:
Michael Clemmons <glassresistor(at)gmail(dot)com>
Cc:
pgsql-hackers(at)postgresql(dot)org,
Greg Smith <greg(at)2ndquadrant(dot)com>,
Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>,
pgsql-performance(at)postgresql(dot)org,
Hannu Krosing <hannu(at)2ndquadrant(dot)com>,
Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
Subject:
Re: [HACKERS] Faster CREATE DATABASE by delaying fsync (was 8.4.1 ubuntu karmic slow createdb)
Date:
2009-12-29 02:55:37
Message-ID:
200912290355.38382.andres@anarazel.de (view raw or flat )
Thread:
2009-12-10 20:41:08 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-10 21:56:59 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-10 22:01:08 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-10 22:09:03 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-11 01:38:25 from Nikolas Everett <nik9000(at)gmail(dot)com>
2009-12-11 17:58:39 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2009-12-11 20:43:59 from Nikolas Everett <nik9000(at)gmail(dot)com>
2009-12-11 20:50:10 from "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
2009-12-11 21:39:34 from Nikolas Everett <nik9000(at)gmail(dot)com>
2009-12-11 21:57:56 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-11 22:12:45 from Scott Carey <scott(at)richrelevance(dot)com>
2009-12-11 22:19:05 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-11 21:59:43 from Scott Mead <scott(dot)lists(at)enterprisedb(dot)com>
2009-12-11 22:12:47 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-13 03:56:42 from Robert Haas <robertmhaas(at)gmail(dot)com>
2009-12-11 22:39:54 from Greg Smith <greg(at)2ndquadrant(dot)com>
2009-12-11 22:52:01 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-11 23:59:13 from Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
2009-12-12 00:19:38 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-12 20:36:27 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-12 20:38:41 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 22:54:51 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 22:59:43 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 18:30:49 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-18 16:35:59 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-19 14:52:25 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-19 14:57:14 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-20 04:13:03 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-20 05:21:07 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-01-27 07:21:44 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-01-19 15:03:16 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-19 15:25:46 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-01-29 18:56:23 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-02 17:36:12 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-02 17:43:15 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-02 17:50:15 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-02 18:14:40 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-02 18:34:07 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-02 19:06:32 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-02 19:08:12 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-02 19:33:30 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-02 19:45:46 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-03 11:53:58 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-03 12:03:04 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-03 13:42:57 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-03 14:19:49 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-06 05:03:30 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-02-06 12:03:50 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-07 05:13:15 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-07 09:23:14 from Greg Smith <greg(at)2ndquadrant(dot)com>
2010-02-07 16:24:00 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-07 18:23:10 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-07 18:27:02 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-08 01:31:42 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-08 03:09:01 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2010-02-08 04:53:23 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-08 07:13:41 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-08 18:34:01 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-08 19:29:46 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-11 02:27:30 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-12 15:49:16 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-14 14:03:44 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-14 15:31:58 from Greg Stark <gsstark(at)mit(dot)edu>
2010-02-14 17:11:39 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-14 17:27:00 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-14 17:37:15 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-02-14 20:24:24 from Florian Weimer <fw(at)deneb(dot)enyo(dot)de>
2010-02-14 20:41:02 from Mark Mielke <mark(at)mark(dot)mielke(dot)cc>
2010-02-14 20:49:09 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-15 00:08:10 from Mark Mielke <mark(at)mark(dot)mielke(dot)cc>
2010-02-14 20:57:08 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-02-14 21:43:23 from Andres Freund <andres(at)anarazel(dot)de>
2010-02-14 23:33:54 from Greg Stark <gsstark(at)mit(dot)edu>
2010-01-20 04:02:17 from Andres Freund <andres(at)anarazel(dot)de>
2010-01-20 04:01:55 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 23:06:28 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2009-12-28 23:20:35 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:46:21 from Greg Smith <greg(at)2ndquadrant(dot)com>
2009-12-29 02:05:39 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 02:53:12 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-29 02:55:37 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 03:04:06 from Michael Clemmons <glassresistor(at)gmail(dot)com>
2009-12-29 03:11:14 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 10:48:10 from Greg Stark <gsstark(at)mit(dot)edu>
2009-12-29 11:13:21 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-28 23:31:56 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:27:29 from Greg Stark <gsstark(at)mit(dot)edu>
2009-12-29 00:29:34 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:30:17 from david(at)lang(dot)hm
2009-12-29 00:43:15 from Andres Freund <andres(at)anarazel(dot)de>
2009-12-29 00:46:26 from david(at)lang(dot)hm
2009-12-28 23:57:42 from Thomas Kellerer <spam_eater(at)gmx(dot)net>
Lists:
pgsql-hackers pgsql-performance
On Tuesday 29 December 2009 03:53:12 Michael Clemmons wrote:
> Andres,
> Great job. Looking through the emails and thinking about why this works I
> think this patch should significantly speedup 8.4 on most any file
> system(obviously some more than others) unless the system has significantly
> reduced memory or a slow single core. On a Celeron with 256 memory I
> suspect it'll crash out or just hit the swap and be a worse bottleneck.
> Anyone have something like this to test on?
Why should it crash? The kernel should just block on writing and write out the
dirty memory before continuing?
Pg is not caching anything here...
Andres
In response to
Responses
pgsql-performance by date
Next :From: Michael ClemmonsDate: 2009-12-29 03:04:06Subject : Re: [HACKERS] Faster CREATE DATABASE by delaying fsync (was 8.4.1 ubuntu karmic slow createdb)Previous :From : Michael ClemmonsDate : 2009-12-29 02:53:12Subject : Re: [HACKERS] Faster CREATE DATABASE by delaying fsync (was 8.4.1 ubuntu karmic slow createdb)
pgsql-hackers by date
Next :From: Michael ClemmonsDate: 2009-12-29 03:04:06Subject : Re: [HACKERS] Faster CREATE DATABASE by delaying fsync (was 8.4.1 ubuntu karmic slow createdb)Previous :From : Michael ClemmonsDate : 2009-12-29 02:53:12Subject : Re: [HACKERS] Faster CREATE DATABASE by delaying fsync (was 8.4.1 ubuntu karmic slow createdb)
