RE: Support logical replication of DDLs

From: "houzj(dot)fnst(at)fujitsu(dot)com" <houzj(dot)fnst(at)fujitsu(dot)com>
To: "wangw(dot)fnst(at)fujitsu(dot)com" <wangw(dot)fnst(at)fujitsu(dot)com>
Cc: vignesh C <vignesh21(at)gmail(dot)com>, Zheng Li <zhengli10(at)gmail(dot)com>, li jie <ggysxcq(at)gmail(dot)com>, Dilip Kumar <dilipbalaut(at)gmail(dot)com>, Peter Smith <smithpb2250(at)gmail(dot)com>, Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, Japin Li <japinli(at)hotmail(dot)com>, rajesh singarapu <rajesh(dot)rs0541(at)gmail(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>, Ajin Cherian <itsajin(at)gmail(dot)com>
Subject: RE: Support logical replication of DDLs
Date: 2023-03-09 09:58:49
Message-ID: OS0PR01MB57163A499F8158D639486A6B94B59@OS0PR01MB5716.jpnprd01.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

On Mon, Mar 6, 2023 18:17 PM Wang, Wei/王 威 <wangw(dot)fnst(at)fujitsu(dot)com> wrote:
> On Mon, Mar 6, 2023 14:34 AM Ajin Cherian <itsajin(at)gmail(dot)com> wrote:
> > Changes are in patch 1 and patch 2
>
> Thanks for updating the patch set.
>
> Here are some comments:

Thanks for your comments.

> For v-75-0002* patch.
> 1. In the function deparse_AlterRelation.
> + if ((sub->address.objectId != relId &&
> + sub->address.objectId != InvalidOid) &&
> + !(subcmd->subtype == AT_AddConstraint &&
> + subcmd->recurse) &&
> + istable)
> + continue;
>
> I think when we execute the command "ALTER TABLE ... ADD (index)"
> (subtype is AT_AddIndexConstraint or AT_AddIndex), this command will
> be skipped for parsing.
> I think we need to parse both types of commands here.

Fixed.

> ~~~
>
> 3. In the function deparse_CreateTrigStmt
> + tgargs = DatumGetByteaP(fastgetattr(trigTup,
> +
> Anum_pg_trigger_tgargs,
> +
> RelationGetDescr(pg_trigger),
> +
> &isnull));
> + if (isnull)
> + elog(ERROR, "null tgargs for trigger \"%s\"",
> + NameStr(trigForm->tgname));
> + argstr = (char *) VARDATA(tgargs);
> + lentgargs = VARSIZE_ANY_EXHDR(tgargs);
> a.
> I think it might be better to invoke the function DatumGetByteaP after
> checking the flag "isnull". Because if "isnull" is true, I think an
> unexpected pointer
> ((NULL)->va_header) will be used when invoking macro VARATT_IS_4B_U.

Fixed.

> b.
> Since commit 3a0d473 recommends using macro DatumGetByteaPP instead of
> DatumGetByteaP, and the function pg_get_triggerdef_worker also uses
> macro DatumGetByteaPP, I think it might be better to use DatumGetByteaPP here.

Changed.

> ~~~
>
> 4. In the function deparse_CreateTrigStmt
> + append_object_object(ret, "EXECUTE PROCEDURE %{function}s",
> tmp_obj);
>
> Since the use of the keyword "PROCEDURE" is historical, I think it
> might be better to use "FUNCTION".

Changed.

> ===
> For v-75-0004* patch.
> 5. File src/test/modules/test_ddl_deparse_regress/README.md
> +1. Test that the generated JSON blob is expected using SQL tests.
> +2. Test that the re-formed DDL command is expected using SQL tests.
> +3. Test that the re-formed DDL command has the same effect as the original
> command
> + by comparing the results of pg_dump, using the SQL tests in 1
> and 2.
> +4. Test that new DDL syntax is handled by the DDL deparser by capturing and
> deparing
> + DDL commands ran by pg_regress.
>
> Inconsistent spacing:
> \t -> blank space

Changed.

Attach the new patch set which addressed above comments and comments from [1].
0001,0002,0003,0004 patch has been updated in this version.

[1] - https://www.postgresql.org/message-id/OS3PR01MB62752246D2A718126825A1809EB59%40OS3PR01MB6275.jpnprd01.prod.outlook.com

Best Regards,
Hou zj

Attachment Content-Type Size
v76-0008-Allow-replicated-objects-to-have-the-same-owner-.patch application/octet-stream 59.2 KB
v76-0001-Infrastructure-to-support-DDL-deparsing.patch application/octet-stream 44.2 KB
v76-0002-Functions-to-deparse-Table-DDL-commands.patch application/octet-stream 131.2 KB
v76-0003-Support-DDL-deparse-of-the-rest-commands.patch application/octet-stream 204.2 KB
v76-0004-Introduce-the-test_ddl_deparse_regress-test-modu.patch application/octet-stream 47.3 KB
v76-0005-DDL-messaging-infrastructure-for-DDL-replication.patch application/octet-stream 41.5 KB
v76-0006-Support-DDL-replication.patch application/octet-stream 207.4 KB
v76-0007-Document-DDL-replication-and-DDL-deparser.patch application/octet-stream 40.6 KB

In response to

Browse pgsql-general by date

  From Date Subject
Next Message houzj.fnst@fujitsu.com 2023-03-09 09:58:52 RE: Support logical replication of DDLs
Previous Message Dominique Devienne 2023-03-09 09:34:45 public schema grants to PUBLIC role

Browse pgsql-hackers by date

  From Date Subject
Next Message houzj.fnst@fujitsu.com 2023-03-09 09:58:52 RE: Support logical replication of DDLs
Previous Message Önder Kalacı 2023-03-09 09:56:00 Re: [PATCH] Use indexes on the subscriber when REPLICA IDENTITY is full on the publisher