RE: Support logical replication of DDLs

From: "houzj(dot)fnst(at)fujitsu(dot)com" <houzj(dot)fnst(at)fujitsu(dot)com>
To: "wangw(dot)fnst(at)fujitsu(dot)com" <wangw(dot)fnst(at)fujitsu(dot)com>
Cc: Runqi Tian <runqidev(at)gmail(dot)com>, vignesh C <vignesh21(at)gmail(dot)com>, Peter Smith <smithpb2250(at)gmail(dot)com>, li jie <ggysxcq(at)gmail(dot)com>, Ajin Cherian <itsajin(at)gmail(dot)com>, Dilip Kumar <dilipbalaut(at)gmail(dot)com>, Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, Japin Li <japinli(at)hotmail(dot)com>, rajesh singarapu <rajesh(dot)rs0541(at)gmail(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>, Zheng Li <zhengli10(at)gmail(dot)com>
Subject: RE: Support logical replication of DDLs
Date: 2023-03-20 09:17:37
Message-ID: OS0PR01MB5716765B2D38786DA3943E0294809@OS0PR01MB5716.jpnprd01.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

On Thu, Mar 16, 2023 10:44 AM Wang, Wei/王 威 <wangw(dot)fnst(at)fujitsu(dot)com> wrote:
> On Tues, Mar 14, 2023 12:17 PM Ajin Cherian <itsajin(at)gmail(dot)com> wrote:
> > On Mon, Mar 13, 2023 at 2:24 AM Zheng Li <zhengli10(at)gmail(dot)com> wrote:
> > >
> > > Thanks for working on the test coverage for CREATE and ALTER TABLE.
> > > I've made fixes for some of the failures in the v79 patch set
> > > (0002,
> > > 0003 and 0004 are updated). The changes includes:
> > > 1. Fixed a syntax error caused by ON COMMIT clause placement in
> > > deparse_CreateStmt.
> > > 2. Fixed deparse_Seq_As and start using it in
> > > deparse_CreateSeqStmt, this issue is also reported in [1].
> > > 3. Fixed a bug in append_not_present: the 'present: false' element
> > > can't be omitted even in non-verbose mode. It will cause syntax
> > > error on reformed command if 'present: false' element is missing
> > > but the fmt string indicates the corresponding object must be present.
> > > 4. Replaced if_not_exists with if_exists in deparse of
> > > AT_DropConstraint and AT_DropColumn.
> > > 5. Added missing CASCADE clause for AT_DropConstraint deparse.
> > > 6. Enabled the fixed test cases.
> > >
> >
> > I found out that the option ONLY was not parsed in the "CREATE INDEX"
> > command,
> > for eg: CREATE UNIQUE INDEX ... ON ONLY table_name ...
> >
> > I've fixed this in patch 0002.
>
> Thanks for the new patch set.
>
> Here are some comments:
>
> For v-80-0002* patch.
> 1. The comments atop the function deparse_IndexStmt.
> + * Verbose syntax
> + * CREATE %{unique}s INDEX %{concurrently}s %{if_not_exists}s
> +%{name}I ON
> + * %{table}D USING %{index_am}s %{definition}s %{with}s
> +%{tablespace}s
> + * %{where_clause}s %{nulls_not_distinct}s */ static ObjTree *
> +deparse_IndexStmt(Oid objectId, Node *parsetree)
>
> Since we added decoding for the [ONLY] option in this version, it
> seems that we also need to add related comments, like this:
> ```
> %{table}D USING %{index_am}s %{definition}s %{with}s %{tablespace}s
> ->
> %{only}s %{table}D USING %{index_am}s %{definition}s %{with}s
> %{tablespace}s ```

Added.
BTW, the parsed %{nulls_not_distinct}s is stored in the wrong order, so moved it from the last position before %{with}s.

> ===
>
> For v-80-0003* patch.
> 2. In the function deparse_CreateTrigStmt.
> I think we need to parse the [OR REPLACE] option for CREATE TRIGGER command.
>
> And I think there are two similar missing in the functions
> deparse_DefineStmt_Aggregate (option [OR REPLACE]) and
> deparse_DefineStmt_Collation (option [IF NOT EXISTS]).

Added.

> ===
>
> For v-80-0004* patch.
> 3. There are some whitespace errors:
> Applying: Introduce the test_ddl_deparse_regress test module.
> .git/rebase-apply/patch:163: new blank line at EOF.
> +
> .git/rebase-apply/patch:3020: new blank line at EOF.
> +
> .git/rebase-apply/patch:4114: new blank line at EOF.
> +
> warning: 3 lines add whitespace errors.

Fixed.

Attach the new patch set which addressed above comments.
0002,0003,0004 patch has been updated in this version.

Best Regards,
Hou zj

Attachment Content-Type Size
v81-0007-Document-DDL-replication-and-DDL-deparser.patch application/octet-stream 40.6 KB
v81-0008-Allow-replicated-objects-to-have-the-same-owner-.patch application/octet-stream 59.2 KB
v81-0001-Infrastructure-to-support-DDL-deparsing.patch application/octet-stream 44.2 KB
v81-0002-Functions-to-deparse-Table-DDL-commands.patch application/octet-stream 131.3 KB
v81-0003-Support-DDL-deparse-of-the-rest-commands.patch application/octet-stream 205.5 KB
v81-0004-Introduce-the-test_ddl_deparse_regress-test-modu.patch application/octet-stream 919.1 KB
v81-0005-DDL-messaging-infrastructure-for-DDL-replication.patch application/octet-stream 41.5 KB
v81-0006-Support-DDL-replication.patch application/octet-stream 200.5 KB

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Dominique Devienne 2023-03-20 10:52:52 NULL pg_database.datacl
Previous Message abdulsayeed24 2023-03-20 05:37:09 Re[2]: Getting error while upgrading postgres from version 12 to 13

Browse pgsql-hackers by date

  From Date Subject
Next Message houzj.fnst@fujitsu.com 2023-03-20 09:19:57 RE: Simplify some codes in pgoutput
Previous Message Kyotaro Horiguchi 2023-03-20 09:05:41 Re: Fix misplaced shared_preload_libraries_in_progress check in few extensions