Re: Parallel Inserts in CREATE TABLE AS

From: Bharath Rupireddy <bharath(dot)rupireddyforpostgres(at)gmail(dot)com>
To: Dilip Kumar <dilipbalaut(at)gmail(dot)com>
Cc: "Hou, Zhijie" <houzj(dot)fnst(at)cn(dot)fujitsu(dot)com>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, Luc Vlaming <luc(at)swarm64(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, Zhihong Yu <zyu(at)yugabyte(dot)com>
Subject: Re: Parallel Inserts in CREATE TABLE AS
Date: 2020-12-21 10:43:09
Message-ID: CALj2ACWs5ExHpS9SacFNaqXMnO4eSDGWroZUhPyv3BfdguDPKA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Dec 18, 2020 at 10:08 AM Dilip Kumar <dilipbalaut(at)gmail(dot)com> wrote:
> I think it will be clean to implement the parallel CTAS when a
> top-level node is the gather node. Basically, the idea is that
> whenever we get the gather on the top which doesn't have any
> projection then we can push down the dest receiver directly to the
> worker. I agree that append is an exception that doesn't do any extra
> processing other than appending the results, So IMHO it would be
> better that in the first part we parallelize the plan where gather
> node on top. I see that we have already worked on the patch where the
> append node is on top so I would suggest that we can keep that part in
> a separate patch.

Thanks! I rearranged the patches to keep the append part separate in
the 0004 patch.

Attaching v13 patch set:

0001 - parallel inserts in ctas without planner enforcement for tuple
cost calculation
0002 - planner enforcement for tuple cost calculation
0003 - tests
0004 - enabling parallel inserts for Append cases, related planner
enforcement code and tests.

Please consider these patches for further review.

With Regards,
Bharath Rupireddy.
EnterpriseDB: http://www.enterprisedb.com

Attachment Content-Type Size
v13-0001-Parallel-Inserts-in-CREATE-TABLE-AS.patch application/octet-stream 33.8 KB
v13-0002-Tuple-Cost-Adjustment-for-Parallel-Inserts-in-CTAS.patch application/octet-stream 12.6 KB
v13-0003-Tests-For-Parallel-Inserts-in-CTAS.patch application/octet-stream 26.1 KB
v13-0004-Enable-CTAS-Parallel-Inserts-For-Append.patch application/octet-stream 44.9 KB

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Maxim Orlov 2020-12-21 10:49:25 Re: [PATCH] Automatic HASH and LIST partition creation
Previous Message Konstantin Knizhnik 2020-12-21 10:06:43 Re: On login trigger: take three