Skip site navigation (1) Skip section navigation (2)

Re: [HACKERS] Performance while loading data and indexing

From: Justin Clift <justin(at)postgresql(dot)org>
To: shridhar_daithankar(at)persistent(dot)co(dot)in
Cc: pgsql-hackers(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 09:56:34
Message-ID: 3D92D9D2.64CF55F7@postgresql.org (view raw or flat)
Thread:
Lists: pgsql-generalpgsql-hackerspgsql-performance
Shridhar Daithankar wrote:
> 
> On 26 Sep 2002 at 19:05, Martijn van Oosterhout wrote:
<snip>
> > fsync IIRC only affects the WAL buffers now but it may be quite expensive,
> > especially considering it's running on every transaction commit. Oh, your
> > WAL files are on a seperate disk from the data?
> 
> No. Same RAID 5 disks..

Not sure if this is a good idea.  Would have to think deeply about the
controller and drive optimisation/load characteristics.

If it's any help, when I was testing recently with WAL on a separate
drive, the WAL logs were doing more read&writes per second than the main
data drive.  This would of course be affected by the queries you are
running against the database.  I was just running Tatsuo's TPC-B stuff,
and the OSDB AS3AP tests.

> I guess we forgot to monitor system parameters. Next on my list is running
> vmstat, top and tuning bdflush.

That'll just be the start of it for serious performance tuning and
learning how PostgreSQL works.  :)

<snip>
> Thanks once again...
> Bye
>  Shridhar

-- 
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
   - Indira Gandhi

In response to

Responses

pgsql-performance by date

Next:From: Tom LaneDate: 2002-09-26 14:33:58
Subject: Re: Performance while loading data and indexing
Previous:From: Justin CliftDate: 2002-09-26 09:49:53
Subject: Re: [HACKERS] Performance while loading data and indexing

pgsql-hackers by date

Next:From: Shridhar DaithankarDate: 2002-09-26 09:58:01
Subject: Re: Performance while loading data and indexing
Previous:From: Patrick WelcheDate: 2002-09-26 09:55:09
Subject: Re: Relation 0 does not exist

pgsql-general by date

Next:From: Peter AlbererDate: 2002-09-26 10:15:00
Subject: Re: Adding "on delete cascade" after table creation ?
Previous:From: Patrick WelcheDate: 2002-09-26 09:55:09
Subject: Re: Relation 0 does not exist

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group