Re: speeding up planning with partitions

From: Amit Langote <Langote_Amit_f8(at)lab(dot)ntt(dot)co(dot)jp>
To: jesper(dot)pedersen(at)redhat(dot)com
Cc: "Imai, Yoshikazu" <imai(dot)yoshikazu(at)jp(dot)fujitsu(dot)com>, "'Amit Langote'" <amitlangote09(at)gmail(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, David Rowley <david(dot)rowley(at)2ndquadrant(dot)com>, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>, Justin Pryzby <pryzby(at)telsasoft(dot)com>, Pg Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: speeding up planning with partitions
Date: 2019-03-05 10:24:26
Message-ID: ee0c1d07-e2bc-57af-6dd7-852eba7df61c@lab.ntt.co.jp
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 2019/03/05 9:50, Amit Langote wrote:
> I'll post the updated patches after diagnosing what
> I'm suspecting a memory over-allocation bug in one of the patches. If you
> configure build with --enable-cassert, you'll see that throughput
> decreases as number of partitions run into many thousands, but it doesn't
> when asserts are turned off.

Attached an updated version. This incorporates fixes for both Jesper's
and Imai-san's review. I haven't been able to pin down the bug (or
whatever) that makes throughput go down as the partition count increases,
when tested with a --enable-cassert build.

Thanks,
Amit

Attachment Content-Type Size
v27-0001-Build-other-rels-of-appendrel-baserels-in-a-sepa.patch text/plain 11.7 KB
v27-0002-Delay-adding-inheritance-child-tables-until-quer.patch text/plain 33.3 KB
v27-0003-Adjust-inheritance_planner-to-reuse-source-child.patch text/plain 20.7 KB
v27-0004-Perform-pruning-in-expand_partitioned_rtentry.patch text/plain 28.7 KB
v27-0005-Teach-planner-to-only-process-unpruned-partition.patch text/plain 7.5 KB
v27-0006-Don-t-copy-PartitionBoundInfo-in-set_relation_pa.patch text/plain 1.6 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Amit Langote 2019-03-05 10:25:13 Re: speeding up planning with partitions
Previous Message David Steele 2019-03-05 10:24:23 Re: Optimization of some jsonb functions