Re: [HACKERS] Performance while loading data and indexing

From: Doug McNaught <doug(at)wireboard(dot)com>
To: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Neil Conway <neilc(at)samurai(dot)com>, shridhar_daithankar(at)persistent(dot)co(dot)in, pgsql-hackers(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 23:26:03
Message-ID: m3ptv0ib90.fsf@varsoon.wireboard.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us> writes:

> Doug McNaught wrote:
> > Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> writes:
> >
> > > We'd be happiest with a filesystem that journals its own metadata and
> > > not the user data in the file(s). I dunno if there are any.
> >
> > ext3 with data=writeback? (See my previous message to Bruce).
>
> OK, so that makes ext3 crash safe without lots of overhead?

Metadata is journaled so you shouldn't lose data blocks or directory
entries. Some data blocks (that haven't been fsync()'ed) may have old
or wrong data in them, but I think that's the same as ufs, right? And
WAL replay should take care of that.

It'd be very interesting to do some tests of the various journaling
modes. I have an old K6 that I might be able to turn into a
hit-the-reset-switch-at-ramdom-times machine. What kind of tests
should be run?

-Doug

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Scott Chapman 2002-09-26 23:42:07 Re: SQL subquery to supply table name?
Previous Message Scott Chapman 2002-09-26 23:04:14 SQL subquery to supply table name?

Browse pgsql-hackers by date

  From Date Subject
Next Message Joe Conway 2002-09-26 23:32:08 Re: About connectby() again
Previous Message Stephan Szabo 2002-09-26 22:44:43 Re: Reconstructing FKs in pg_dump

Browse pgsql-performance by date

  From Date Subject
Next Message Yusuf Goolamabbas 2002-09-27 02:55:10 Would ext3 data=journal help for Postgres synchronous io mode
Previous Message Bruce Momjian 2002-09-26 22:04:52 Re: [HACKERS] Performance while loading data and indexing