Re: slow building index and reference after Sybase to Pg

From: Andy Colson <andy(at)squeakycode(dot)net>
To: Gary Fu <gfu(at)sigmaspace(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: slow building index and reference after Sybase to Pg
Date: 2011-02-25 22:22:53
Message-ID: 4D682BBD.20904@squeakycode.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 2/23/2011 12:31 PM, Gary Fu wrote:
> Hi,
>
> I'm testing on converting a big Sybase db to Pg. It took about 45 hours
> to convert all sybase tables (bcp) to Pg (copy) without index and
> reference. After that I built the index (one by one, sequentially) and
> it took about 25 hours and then I started to add the references (one by
> one), however, it has been more than 30 hours and still has no sign of
> finishing. I wonder, is there any suggestion that may speed up the index
> and reference building (on Pg).
>
> Thanks,
> Gary
>

In addition to Toms answer, disable fsync for a bit.

( http://www.postgresql.org/docs/9.0/static/non-durability.html )

Also, why one at a time? Are you IO bound? If you are IO bound then
ok, but otherwise try a few at a time. (I mean COPY, create index, and
add constraint)

While this was going on, did you view vmstat? Did you look at PG's log?

-Andy

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Bosco Rama 2011-02-25 22:36:46 Re: finding strings with quotes
Previous Message Jimmy Zhang 2011-02-25 22:03:40 [ANN]VTD-XML 2.10