From: | "Steven Flatt" <steven(dot)flatt(at)gmail(dot)com> |
---|---|
To: | "Colin Taylor" <colin(dot)taylor(at)gmail(dot)com> |
Cc: | pgsql-performance(at)postgresql(dot)org |
Subject: | Re: table partioning performance |
Date: | 2007-01-08 20:02:24 |
Message-ID: | 357fa7590701081202p726c049ej61390dd1816d1369@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers pgsql-performance |
On 1/6/07, Colin Taylor <colin(dot)taylor(at)gmail(dot)com> wrote:
> Hi there, we've partioned a table (using 8.2) by day due to the 50TB of
> data (500k row size, 100G rows) we expect to store it in a year.
> Our performance on inserts and selects against the master table is
> disappointing, 10x slower (with ony 1 partition constraint) than we get by
> going to the partioned table directly.
Are you implementing table partitioning as described at:
http://developer.postgresql.org/pgdocs/postgres/ddl-partitioning.html ?
If yes, and if I understand your partitioning "by day" correctly, then you
have one base/master table with 366 partitions (inherited/child tables). Do
each of these partitions have check constraints and does your master table
use rules to redirect inserts to the appropriate partition? I guess I don't
understand your "only 1 partition constraint" comment.
We use partitioned tables extensively and we have observed linear
performance degradation on inserts as the number of rules on the master
table grows (i.e. number of rules = number of partitions). We had to come
up with a solution that didn't have a rule per partition on the master
table. Just wondering if you are observing the same thing.
Selects shouldn't be affected in the same way, theoretically, if you have
constraint_exclusion enabled.
Steve
From | Date | Subject | |
---|---|---|---|
Next Message | Magnus Hagander | 2007-01-08 20:09:43 | README for vcbuild |
Previous Message | Magnus Hagander | 2007-01-08 19:56:37 | vcbuild optional packages |
From | Date | Subject | |
---|---|---|---|
Next Message | Merlin Moncure | 2007-01-09 00:35:31 | Re: table partioning performance |
Previous Message | Dave Dutcher | 2007-01-08 18:59:14 | Re: Slow Query on Postgres 8.2 |