Skip site navigation (1) Skip section navigation (2)

Re: Looking for ideas on how to speed up warehouse loading

From: "scott(dot)marlowe" <scott(dot)marlowe(at)ihs(dot)com>
To: Sean Shanny <shannyconsulting(at)earthlink(dot)net>
Cc: <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Looking for ideas on how to speed up warehouse loading
Date: 2004-04-23 16:25:01
Message-ID: Pine.LNX.4.33.0404231022440.26996-100000@css120.ihs.com (view raw or flat)
Thread:
Lists: pgsql-performance
On Thu, 22 Apr 2004, Sean Shanny wrote:

> I should have included this as well:
>  fsync                          | on
>  shared_buffers                 | 4000
>  sort_mem                       | 64000

For purposes of loading only, you can try turning off fsync, assuming this 
is a virgin load and you can just re-initdb should bad things happen (OS, 
postgresql crash, power plug pulled, etc...)

Also increasing sort_mem and shared_buffers might help.  Especially 
sort_mem.  But turn it back down to something reasonable after the import.

And turn fsync back on after the import too.  Note you have to restart 
postgresql to make fsync = off take effect.


In response to

pgsql-performance by date

Next:From: Josh BerkusDate: 2004-04-23 16:42:48
Subject: Re: Help with performance problems
Previous:From: Aaron WermanDate: 2004-04-23 15:16:13
Subject: Re: Help with performance problems

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group