Skip site navigation (1) Skip section navigation (2)

Re: Best COPY Performance

From: "Worky Workerson" <worky(dot)workerson(at)gmail(dot)com>
To: "Jim C(dot) Nasby" <jim(at)nasby(dot)net>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Best COPY Performance
Date: 2006-10-31 20:22:11
Message-ID: ce4072df0610311222l2d3edf91uf15119c53fe886d5@mail.gmail.com (view raw or flat)
Thread:
Lists: pgsql-performance
> >I'm guessing the high bursts are checkpoints.  Can you check your log
> > >files for pg and see if you are getting warnings about checkpoint
> > >frequency?   You can get some mileage here by increasing wal files.
> >
> > Nope, nothing in the log.  I have set:
> > wal_buffers=128
> > checkpoint_segments=128
> > checkpoint_timeout=3000
> > which I thought was rather generous.  Perhaps I should set it even
> > higher for the loads?
>
> But depending on your shared_buffer and bgwriter settings (as well as
> how much WAL traffic you're generating, you could still end up with big
> slugs of work to be done when checkpoints happen.
>
> If you set checkpoint_warning to 3001, you'll see exactly when
> checkpoints are happening, so you can determine if that's an issue.

I did that, and I get two log messages, seeing checkpoints happening
at 316 and 147 seconds apart on my load of a 1.9 GB file.  Is this "an
issue"?

Thanks!

In response to

pgsql-performance by date

Next:From: Worky WorkersonDate: 2006-10-31 20:45:16
Subject: Re: Best COPY Performance
Previous:From: Luke LonerganDate: 2006-10-31 20:16:24
Subject: Re: Best COPY Performance

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group