Re: WAL partition overloaded--by autovacuum?

From: "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
To: <richyen(at)iparadigms(dot)com>,<slony1-general(at)lists(dot)slony(dot)info>, <pgsql-performance(at)postgresql(dot)org>
Subject: Re: WAL partition overloaded--by autovacuum?
Date: 2010-07-07 11:58:25
Message-ID: 4C34259102000025000330B6@gw.wicourts.gov
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Richard Yen wrote:

> the pg_xlog partition filled up (33GB)

> checkpoint_segments=16

> a sudden flurry of write activity

Was this database bulk-loaded in some way (like by restoring the
output of pg_dump, for example)? If so, all rows inserted into all
tables would have the same (or very nearly the same) xmin value. At
some later time, virtually all tuples would need to be rewritten to
freeze them. This would be a logged operation, so WAL files would be
getting created rapidly. If you have WAL archiving turned on, and
you can't copy the files out as fast as they're being created, this
might happen.

To avoid such a crushing mass freeze at an unpredictable time, we
always run VACUUM FREEZE ANALYZE on a bulk-loaded database before
turning on WAL archiving.

Of course, if this database wasn't bulk-loaded, this can't be your
problem....

-Kevin

Browse pgsql-performance by date

  From Date Subject
Next Message Matthew Wakeling 2010-07-07 12:34:18 Re: Two different execution plan for the same request
Previous Message JOUANIN Nicolas (44) 2010-07-07 11:27:07 Re: Two different execution plan for the same request