Re: table partioning performance

From: "Steven Flatt" <steven(dot)flatt(at)gmail(dot)com>
To: "Colin Taylor" <colin(dot)taylor(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: table partioning performance
Date: 2007-01-08 20:02:24
Message-ID: 357fa7590701081202p726c049ej61390dd1816d1369@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

On 1/6/07, Colin Taylor <colin(dot)taylor(at)gmail(dot)com> wrote:

> Hi there, we've partioned a table (using 8.2) by day due to the 50TB of
> data (500k row size, 100G rows) we expect to store it in a year.
> Our performance on inserts and selects against the master table is
> disappointing, 10x slower (with ony 1 partition constraint) than we get by
> going to the partioned table directly.

Are you implementing table partitioning as described at:
http://developer.postgresql.org/pgdocs/postgres/ddl-partitioning.html ?

If yes, and if I understand your partitioning "by day" correctly, then you
have one base/master table with 366 partitions (inherited/child tables). Do
each of these partitions have check constraints and does your master table
use rules to redirect inserts to the appropriate partition? I guess I don't
understand your "only 1 partition constraint" comment.

We use partitioned tables extensively and we have observed linear
performance degradation on inserts as the number of rules on the master
table grows (i.e. number of rules = number of partitions). We had to come
up with a solution that didn't have a rule per partition on the master
table. Just wondering if you are observing the same thing.

Selects shouldn't be affected in the same way, theoretically, if you have
constraint_exclusion enabled.

Steve

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Magnus Hagander 2007-01-08 20:09:43 README for vcbuild
Previous Message Magnus Hagander 2007-01-08 19:56:37 vcbuild optional packages

Browse pgsql-performance by date

  From Date Subject
Next Message Merlin Moncure 2007-01-09 00:35:31 Re: table partioning performance
Previous Message Dave Dutcher 2007-01-08 18:59:14 Re: Slow Query on Postgres 8.2