Re: Support logical replication of DDLs

From: vignesh C <vignesh21(at)gmail(dot)com>
To: shveta malik <shveta(dot)malik(at)gmail(dot)com>
Cc: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, "Zhijie Hou (Fujitsu)" <houzj(dot)fnst(at)fujitsu(dot)com>, Ajin Cherian <itsajin(at)gmail(dot)com>, "Wei Wang (Fujitsu)" <wangw(dot)fnst(at)fujitsu(dot)com>, Runqi Tian <runqidev(at)gmail(dot)com>, Peter Smith <smithpb2250(at)gmail(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, li jie <ggysxcq(at)gmail(dot)com>, Dilip Kumar <dilipbalaut(at)gmail(dot)com>, Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, Japin Li <japinli(at)hotmail(dot)com>, rajesh singarapu <rajesh(dot)rs0541(at)gmail(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>, Zheng Li <zhengli10(at)gmail(dot)com>
Subject: Re: Support logical replication of DDLs
Date: 2023-05-30 11:19:18
Message-ID: CALDaNm0TXZ7VfN5gfKk55CVqyuDW75NTQPtPa3X9MY8zP76g2Q@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

On Tue, 30 May 2023 at 08:23, shveta malik <shveta(dot)malik(at)gmail(dot)com> wrote:
>
> On Mon, May 29, 2023 at 6:16 PM vignesh C <vignesh21(at)gmail(dot)com> wrote:
> >
>
> > >
> > > I found few comments while making some changes to the patch:
> > > 1) Now that objtree is removed, these comments should be modified:
> > > * Deparse object tree is created by using:
> > > * a) new_objtree("know contents") where the complete tree content is known or
> > > * the initial tree content is known.
> > > * b) new_objtree("") for the syntax where the object tree will be derived
> > > * based on some conditional checks.
> > > * c) new_objtree_VA where the complete tree can be derived using some fixed
> > > * content or by using the initial tree content along with some variable
> > > * arguments.
> > > *
> >
> > Modified
> >
> > > 2) isgrant can be removed as it is not used anymore:
> > > +/*
> > > + * Return the given object type as a string.
> > > + *
> > > + * If isgrant is true, then this function is called while deparsing GRANT
> > > + * statement and some object names are replaced.
> > > + */
> > > +const char *
> > > +stringify_objtype(ObjectType objtype, bool isgrant)
> > > +{
> > > + switch (objtype)
> > > + {
> > > + case OBJECT_TABLE:
> > > + return "TABLE";
> > > + default:
> > > + elog(ERROR, "unsupported object type %d", objtype);
> > > + }
> > > +
> > > + return "???"; /* keep compiler quiet */
> > > +}
> >
> > Modified
> >
> > > 3) This statement is not being handled currently, it should be implemented:
> > > "alter table all in tablespace tbs1 set tablespace"
> >
> > Modified
> >
>
> With the above fix, are the below commented tests in alter_table.sql
> supposed to work? If so, shall these be uncommented?
> -- ALTER TABLE ALL IN TABLESPACE pg_default SET TABLESPACE pg_default;
> -- ALTER TABLE ALL IN TABLESPACE pg_default OWNED BY ddl_testing_role
> SET TABLESPACE pg_default;

The attached patch has the changes for the above. I have also
uncommented another couple of tests in alter_table which was failing
because it was capturing the internally generated indexes from alter
table, I have updated deparse_drops_to_json accordingly to capture
only table related drop commands. The attached patch has the changes
for the same. The changes were done in
0008-ObjTree-Removal-for-multiple-commands-2023_05_30.patch for the
same.

Regards,
Vignesh

Attachment Content-Type Size
0003-Add-verbose-option-for-ddl-deparse-module-2023_05_30.patch text/x-patch 47.1 KB
0002-Enhance-the-event-trigger-to-support-DDL-deparsing-2023_05_30.patch text/x-patch 33.9 KB
0001-Deparser-for-Table-DDL-commands-and-extending-event-2023_05_30.patch text/x-patch 167.3 KB
0005-DDL-replication-for-Table-DDL-commands-2023_05_30.patch text/x-patch 248.2 KB
0004-Introduce-the-test_ddl_deparse_regress-test-module-2023_05_30.patch text/x-patch 977.8 KB
0006-Add-subscription-tap-test-for-DDL-replication-for-TA-2023_05_30.patch text/x-patch 20.8 KB
0007-Apply-the-DDL-change-as-that-same-user-that-executed-2023_05_30.patch text/x-patch 60.0 KB
0008-ObjTree-Removal-for-multiple-commands-2023_05_30.patch text/x-patch 1.7 MB

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Marc Millas 2023-05-30 13:45:11 syntax pb
Previous Message Laurenz Albe 2023-05-30 07:24:52 Re: Where I can find the achieve of the 'generate_series' ?

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Eisentraut 2023-05-30 11:20:54 Re: Large files for relations
Previous Message Drouvot, Bertrand 2023-05-30 10:34:30 Test slots invalidations in 035_standby_logical_decoding.pl only if dead rows are removed