Re: Insert statements really slow

From: Andrew Sullivan <ajs(at)crankycanuck(dot)ca>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: Insert statements really slow
Date: 2007-11-09 18:01:33
Message-ID: 20071109180133.GY24585@crankycanuck.ca
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Fri, Nov 09, 2007 at 11:53:08AM -0600, Waller, David wrote:
> The data is web log data and each line has a variable amount of the
> fields (mostly because of cookies) so I am using a lot of insert
> statements.
>
> In MySQL I go through a file in about 2 minutes and it is taking about
> 30 in PG. I have removed all but the primary key index and have done a
> BEGIN and COMMIT after turning off AUTOCOMMIT.
>
> What other things should I be looking at to spped this up?

It could be that your server is doing too much work because you don't have
enough WAL segments or something.

But I'd suggest looking at COPY for bulk imports. It's way faster.

A

--
Andrew Sullivan
Old sigs will return after re-constitution of blue smoke

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Scott Marlowe 2007-11-09 19:18:18 Re: Insert statements really slow
Previous Message Waller, David 2007-11-09 17:53:08 Insert statements really slow