Re: [HACKERS] Performance while loading data and indexing

From: Doug cNaught <doug(at)wireboard(dot)com>
To: Greg Copeland <greg(at)CopelandConsulting(dot)Net>
Cc: shridhar_daithankar(at)persistent(dot)co(dot)in, PostgresSQL Hackers Mailing List <pgsql-hackers(at)postgresql(dot)org>, PostgresSQL General Mailing List <pgsql-general(at)postgresql(dot)org>
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 17:16:36
Message-ID: m34rcck6x7.fsf@varsoon.wireboard.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

Greg Copeland <greg(at)CopelandConsulting(dot)Net> writes:

> I'm not sure about reiserfs or ext3 but with XFS, you can create your
> log on another disk. Also worth noting is that you can also configure
> the size and number of log buffers. There are also some other
> performance type enhancements you can fiddle with if you don't mind
> risking time stamp consistency in the event of a crash. If your setup
> allows for it, you might want to consider using XFS in this
> configuration.

You can definitely put the ext3 log on a different disk with 2.4
kernels.

Also, if you put the WAL logs on a different disk from the main
database, and mount that partition with 'data=writeback' (ie
metadata-only journaling) ext3 should be pretty fast, since WAL files
are preallocated and there will therefore be almost no metadata
updates.

You should be able to mount the main database with "data=ordered" (the
default) for good performance and reasonable safety.

I think putting WAL on its own disk(s) is one of the keys here.

-Doug

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Greg Copeland 2002-09-26 17:36:57 Re: [HACKERS] Performance while loading data and indexing
Previous Message Andrew Sullivan 2002-09-26 17:15:21 Re: unlock / drop table

Browse pgsql-hackers by date

  From Date Subject
Next Message Masaru Sugawara 2002-09-26 17:27:05 Re: About connectby() again
Previous Message Masaru Sugawara 2002-09-26 17:02:49 About connectby() again

Browse pgsql-performance by date

  From Date Subject
Next Message Greg Copeland 2002-09-26 17:36:57 Re: [HACKERS] Performance while loading data and indexing
Previous Message Bruce Momjian 2002-09-26 16:41:34 Re: Performance while loading data and indexing