Skip site navigation (1) Skip section navigation (2)

Re: slow DELETE on 12 M row table

From: Greg Stark <gsstark(at)mit(dot)edu>
To: Janet Jacobsen <jsjacobsen(at)lbl(dot)gov>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: slow DELETE on 12 M row table
Date: 2009-06-26 03:17:49
Message-ID: 407d949e0906252017l6591007w3c4a9f452580cb24@mail.gmail.com (view raw or flat)
Thread:
Lists: pgsql-performance
On Fri, Jun 26, 2009 at 3:33 AM, Janet Jacobsen<jsjacobsen(at)lbl(dot)gov> wrote:
> (1) is my interpretation of the posts correct, i.e., if I am deleting
> rows from
> table1, where the pkey of table 1 is a fkey in table 2, then do I need
> to create an
> index on the fkey field in table 2?

Exactly right. The index on the table2 is optional but deletes and
updates on table1 will be very slow without it as it has to do a full
table scan of table2 to ensure no references remain.

> (2) do you have any suggestions on how I can determine why it is taking
> several hours to create an index on a field in a table with 12 M rows?  does
> that seem like a reasonable amount of time?  I have maintenance_work_mem
> set to 512MB - is that too low, or is that the wrong config parameter to
> change?
> [ps aux shows "CREATE INDEX waiting"; there is nothing (no image processing)
> running on the machine at this time]

512MB is a perfectly reasonable maintenance_work_mem. Larger than that
is overkill.

"waiting" means it's blocked trying to acquire a lock. Some open
transaction has the table you're trying to index locked. Look in
pg_locks and pg_stat_activity to find out who.


> (3) would I be better off dropping the foreign keys?  in general, is it
> workable to
> have foreign keys on tables with > 100 M rows (assuming I create all of
> the 'right'
> indexes)?

If you have the right indexes then the size of the table shouldn't be
a large factor. The number of transactions per second being processed
are perhaps more of a factor but even on very busy systems, most of
the time foreign key constraints aren't a problem to keep.

-- 
greg
http://mit.edu/~gsstark/resume.pdf

In response to

Responses

pgsql-performance by date

Next:From: Richard HuxtonDate: 2009-06-26 05:47:41
Subject: Re: slow DELETE on 12 M row table
Previous:From: Janet JacobsenDate: 2009-06-26 02:33:11
Subject: slow DELETE on 12 M row table

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group