Out of swap space & memory

From: "Kevin Bartz" <kbartz(at)loyaltymatrix(dot)com>
To: <pgsql-general(at)postgresql(dot)org>
Subject: Out of swap space & memory
Date: 2004-08-03 03:08:45
Message-ID: 20040803031430.DD2F03FCB8@omta16.mta.everyone.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

I'm de-duping a 45-million-row table (about 4 gigs) by creating a new table
with the unique rows of the first table (should be about 3 gigs). I'm on a
64-bit SuSE Linux with 2 gigs of memory and another gig of swap space. I
tracked postmaster's use of memory and swap space after I run the query, and
I noticed that as soon as postmaster first uses up all available memory and
swap space, I get this:

2004-08-02 19:35:52 LOG: checkpoint record is at 7/4AA2F590
2004-08-02 19:35:52 LOG: redo record is at 7/4AA2F590; undo record is at
0/0; shutdown TRUE
2004-08-02 19:35:52 LOG: next transaction ID: 740; next OID: 116212470
2004-08-02 19:35:52 LOG: database system is ready
2004-08-02 19:38:04 LOG: server process (PID 25302) was terminated by
signal 9
2004-08-02 19:38:04 LOG: terminating any other active server processes
2004-08-02 19:38:04 LOG: all server processes terminated; reinitializing
2004-08-02 19:38:04 FATAL: the database system is starting up
2004-08-02 19:38:04 LOG: database system was interrupted at 2004-08-02
19:35:52 PDT
2004-08-02 19:38:05 LOG: checkpoint record is at 7/4AA2F590
2004-08-02 19:38:05 LOG: redo record is at 7/4AA2F590; undo record is at
0/0; shutdown TRUE
2004-08-02 19:38:05 LOG: next transaction ID: 740; next OID: 116212470
2004-08-02 19:38:05 LOG: database system was not properly shut down;
automatic recovery in progress
2004-08-02 19:38:05 LOG: redo starts at 7/4AA2F5D8
2004-08-02 19:38:05 LOG: record with zero length at 7/4AA4D5C0
2004-08-02 19:38:05 LOG: redo done at 7/4AA4B560
2004-08-02 19:38:07 LOG: database system is ready

And the query never completes. This happens reproducibly and consistently. I
like to think that two gigs should be enough memory. What is killing the
postmaster process and how can I stop it? And, more importantly, is there
any way I can run this query? Thanks for any help you can provide,

Kevin

Responses

Browse pgsql-general by date

  From Date Subject
Next Message mike g 2004-08-03 03:39:33 Re: Out of swap space & memory
Previous Message Robert Treat 2004-08-03 02:47:24 == PostgreSQL Weekly News - August 1st 2004 ==