Re: Parallel Inserts in CREATE TABLE AS

From: Bharath Rupireddy <bharath(dot)rupireddyforpostgres(at)gmail(dot)com>
To: Luc Vlaming <luc(at)swarm64(dot)com>
Cc: Zhihong Yu <zyu(at)yugabyte(dot)com>, Dilip Kumar <dilipbalaut(at)gmail(dot)com>, vignesh C <vignesh21(at)gmail(dot)com>, "Hou, Zhijie" <houzj(dot)fnst(at)cn(dot)fujitsu(dot)com>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Parallel Inserts in CREATE TABLE AS
Date: 2021-01-05 03:59:19
Message-ID: CALj2ACVtLVmNnUP=NKLO71KXBVvJR8zcW80+EtXoQS6qYmHbMw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Mon, Jan 4, 2021 at 7:02 PM Bharath Rupireddy
<bharath(dot)rupireddyforpostgres(at)gmail(dot)com> wrote:
>
> > + if (IS_PARALLEL_CTAS_DEST(gstate->dest) &&
> > + ((DR_intorel *) gstate->dest)->into->rel &&
> > + ((DR_intorel *) gstate->dest)->into->rel->relname)
> > why would rel and relname not be there? if no rows have been inserted?
> > because it seems from the intorel_startup function that that would be
> > set as soon as startup was done, which i assume (wrongly?) is always done?
>
> Actually, that into clause rel variable is always being set in the gram.y for CTAS, Create Materialized View and SELECT INTO (because qualified_name non-terminal is not optional). My bad. I just added it as a sanity check. Actually, it's not required.
>
> create_as_target:
> qualified_name opt_column_list table_access_method_clause
> OptWith OnCommitOption OptTableSpace
> {
> $$ = makeNode(IntoClause);
> $$->rel = $1;
> create_mv_target:
> qualified_name opt_column_list table_access_method_clause opt_reloptions OptTableSpace
> {
> $$ = makeNode(IntoClause);
> $$->rel = $1;
> into_clause:
> INTO OptTempTableName
> {
> $$ = makeNode(IntoClause);
> $$->rel = $2;
>
> I will change the below code:
> + if (GetParallelInsertCmdType(gstate->dest) ==
> + PARALLEL_INSERT_CMD_CREATE_TABLE_AS &&
> + ((DR_intorel *) gstate->dest)->into &&
> + ((DR_intorel *) gstate->dest)->into->rel &&
> + ((DR_intorel *) gstate->dest)->into->rel->relname)
> + {
>
> to:
> + if (GetParallelInsertCmdType(gstate->dest) ==
> + PARALLEL_INSERT_CMD_CREATE_TABLE_AS)
> + {
>
> I will update this in the next version of the patch set.

Attaching v20 patch set that has above change in 0001 patch, note that
0002 to 0004 patches have no changes from v19. Please consider the v20
patch set for further review.

With Regards,
Bharath Rupireddy.
EnterpriseDB: http://www.enterprisedb.com

Attachment Content-Type Size
v20-0001-Parallel-Inserts-in-CREATE-TABLE-AS.patch application/x-patch 36.3 KB
v20-0002-Tuple-Cost-Adjustment-for-Parallel-Inserts-in-CTAS.patch application/x-patch 15.4 KB
v20-0003-Tests-And-Docs-For-Parallel-Inserts-in-CTAS.patch application/x-patch 29.8 KB
v20-0004-Enable-CTAS-Parallel-Inserts-For-Append.patch application/x-patch 46.2 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Mark Dilger 2021-01-05 04:03:27 Re: macOS SIP, next try
Previous Message Thomas Munro 2021-01-05 03:58:36 Cirrus CI (Windows help wanted)