Re: [HACKERS] Performance while loading data and indexing

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Doug McNaught <doug(at)wireboard(dot)com>
Cc: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>, Greg Copeland <greg(at)copelandconsulting(dot)net>, shridhar_daithankar(at)persistent(dot)co(dot)in, PostgresSQL Hackers Mailing List <pgsql-hackers(at)postgresql(dot)org>, PostgresSQL General Mailing List <pgsql-general(at)postgresql(dot)org>
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-27 03:07:44
Message-ID: 20359.1033096064@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

Doug McNaught <doug(at)wireboard(dot)com> writes:
> "data=writeback" means that no data is journaled, just metadata (which
> is like XFS or Reiser). An fsync() call should still do what it
> normally does, commit the writes to disk before returning.
> "data=journal" journals all data and is the slowest and safest.
> "data=ordered" writes out data blocks before committing a journal
> transaction, which is faster than full data journaling (since data
> doesn't get written twice) and almost as safe. "data=writeback" is
> noted to keep obsolete data in the case of some crashes (since the
> data may not have been written yet) but a completed fsync() should
> ensure that the data is valid.

Thanks for the explanation.

> So I guess I'd probably use data=ordered for an all-on-one-fs
> installation, and data=writeback for a WAL-only drive.

Actually I think the ideal thing for Postgres would be data=writeback
for both data and WAL drives. We can handle loss of un-fsync'd data
for ourselves in both cases.

Of course, if you keep anything besides Postgres data files on a
partition, you'd possibly want the more secure settings.

regards, tom lane

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Alvaro Herrera 2002-09-27 03:31:06 Re: get date in binary number format
Previous Message Tom Lane 2002-09-27 02:52:17 Re: get date in binary number format

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2002-09-27 03:42:44 Re: hacker help: PHP-4.2.3 patch to allow restriction of database access
Previous Message Jim Mercer 2002-09-27 02:08:29 Re: hacker help: PHP-4.2.3 patch to allow restriction of database access

Browse pgsql-performance by date

  From Date Subject
Next Message Yury Bokhoncovich 2002-09-27 05:14:40 Re: [HACKERS] Performance while loading data and indexing
Previous Message Yusuf Goolamabbas 2002-09-27 02:55:10 Would ext3 data=journal help for Postgres synchronous io mode