Re: Postgres delete performance problem

From: Alejandro Carrillo <fasterzip(at)yahoo(dot)es>
To: Frits Jalvingh <jal(at)etc(dot)to>, "pgsql-performance(at)postgresql(dot)org" <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Postgres delete performance problem
Date: 2012-06-25 19:14:21
Message-ID: 1340651661.3160.YahooMailNeo@web171006.mail.ukl.yahoo.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

"It does so by removing all constraints, then it compares table contents row by row, inserts missing rows and deletes "extra" rows in the target database."
If the delete's you do when the constraints and indexes are removed then you need to create the constraints and indexes before you delete the rows

>________________________________
> De: Frits Jalvingh <jal(at)etc(dot)to>
>Para: pgsql-performance(at)postgresql(dot)org
>Enviado: Lunes 25 de junio de 2012 10:42
>Asunto: [PERFORM] Postgres delete performance problem
>
>
>Hi,
>
>
>I have a Java application that tries to synchronize tables in two databases (remote source to local target). It does so by removing all constraints, then it compares table contents row by row, inserts missing rows and deletes "extra" rows in the target database. Delete performance is incredibly bad: it handles 100 record deletes in about 16 to 20 seconds(!). Insert and update performance is fine.
>
>
>The Java statement to handle the delete uses a prepared statement:
>
>
>"delete from xxx where xxx_pk=?"
>
>
>The delete statement is then executed using addBatch() and executeBatch() (the latter every 100 deletes), and committed. Not using executeBatch makes no difference.
>
>
>An example table where deletes are slow:
>
>
>pzlnew=# \d cfs_file
>                  Table "public.cfs_file"
>      Column      |            Type             | Modifiers 
>------------------+-----------------------------+-----------
> cfsid            | bigint                      | not null
> cfs_date_created | timestamp without time zone | not null
> cfs_name         | character varying(512)      | not null
> cfs_cfaid        | bigint                      | 
> cfs_cfdid        | bigint                      | 
>Indexes:
>    "cfs_file_pkey" PRIMARY KEY, btree (cfsid)
>
>
>with no FK constraints at all, and a table size of 940204 rows.
>
>
>While deleting, postgres takes 100% CPU all of the time.
>
>
>
>
>Inserts and updates are handled in exactly the same way, and these are a few orders of magnitude faster than the deletes.
>
>
>I am running the DB on an Ubuntu 12.04 - 64bits machine with Postgres 9.1, the machine is a fast machine with the database on ssd, ext4, with 16GB of RAM and a  i7-3770 CPU @ 3.40GHz.
>
>
>Anyone has any idea?
>
>
>Thanks in advance,
>
>
>Frits
>
>
>
>

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2012-06-25 20:15:31 Re: MemSQL the "world's fastest database"?
Previous Message gnuoytr 2012-06-25 18:02:41 Re: MemSQL the "world's fastest database"?