Skip site navigation (1) Skip section navigation (2)

Re: Massive table (500M rows) update nightmare

From: Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
To: Carlo Stonebanks <stonec(dot)register(at)sympatico(dot)ca>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Massive table (500M rows) update nightmare
Date: 2010-01-08 01:40:14
Message-ID: dcc563d11001071740q572cdae2re410788fe790dbf6@mail.gmail.com (view raw or flat)
Thread:
Lists: pgsql-performance
On Thu, Jan 7, 2010 at 2:48 PM, Carlo Stonebanks
<stonec(dot)register(at)sympatico(dot)ca> wrote:
> Doing the updates in smaller chunks resolved these apparent freezes - or,
> more specifically, when the application DID freeze, it didn't do it for more
> than 30 seconds. In all likelyhood, this is the OS and the DB thrashing.

It might well be checkpoints.  Have you tried cranking up checkpoint
segments to something like 100 or more and seeing how it behaves then?

In response to

Responses

pgsql-performance by date

Next:From: Scott MarloweDate: 2010-01-08 01:59:39
Subject: Re: "large" spam tables and performance: postgres memory parameters
Previous:From: Greg SmithDate: 2010-01-08 00:38:34
Subject: Re: Air-traffic benchmark

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group