Re: table partioning performance

From: "Merlin Moncure" <mmoncure(at)gmail(dot)com>
To: "Colin Taylor" <colin(dot)taylor(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: table partioning performance
Date: 2007-01-09 00:35:31
Message-ID: b42b73150701081635u6c458492i38b0057a8d89723b@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

On 1/7/07, Colin Taylor <colin(dot)taylor(at)gmail(dot)com> wrote:
> Hi there, we've partioned a table (using 8.2) by day due to the 50TB of
> data (500k row size, 100G rows) we expect to store it in a year.
> Our performance on inserts and selects against the master table is
> disappointing, 10x slower (with ony 1 partition constraint) than we get by
> going to the partioned table directly. Browsing the list I get the
> impression this just a case of too many partitions? would be better off
> doing partitions of partitions ?
>
> Any other advice or pointers to more information with dealing with these
> sorts of scales appreciated.

as others have stated, something is not set up correctly. table
partitioning with constraint exclusion should be considerably faster
for situations were the planner can optimize for it (select queries
are case dependent, but inserts are not).

also, I would like to speak for everybody else here and ask for as
much detail as possible about the hardware and software challenges you
are solving :-) in particular, I am curious how you arrived at 500k
row size.

merlin

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Jim C. Nasby 2007-01-09 01:25:42 Re: ideas for auto-processing patches
Previous Message Tom Lane 2007-01-09 00:14:21 Re: [HACKERS] SGML index build fix

Browse pgsql-performance by date

  From Date Subject
Next Message Gregory S. Williamson 2007-01-09 11:55:56 Horribly slow query/ sequential scan
Previous Message Steven Flatt 2007-01-08 20:02:24 Re: table partioning performance