Re: Regarding logical replication issues with PostgreSQL versions 16 and above

From: Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>
To: yexiu-glory <yexiu-glory(at)qq(dot)com>, pgsql-general <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Regarding logical replication issues with PostgreSQL versions 16 and above
Date: 2025-07-18 13:40:06
Message-ID: 196cd52eacfb03ec788cadc4a8bf02c83207d9aa.camel@cybertec.at
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Fri, 2025-07-18 at 19:08 +0800, yexiu-glory wrote:
> I'm facing a problem here: our business requires logical data replication to other
> departments, but at the same time, sensitive fields need to be filtered out.
> Therefore, we used the column filtering function when creating logical replication.
> If we use `alter table table1 replica identity default;`, there is no issue at all.
> However, when encountering new business scenarios, we need to use the CSI columnar
> index function. Under the default setting, the synchronization delay of the CSI
> columnar index is severe. Therefore, we need to use `alter table table1 replica
> identity full;` so that the CSI columnar index can perform data comparison and only
> convert changed data when receiving data, thereby speeding up the data conversion
> efficiency of the CSI columnar index. However, after using `alter table table1
> replica identity full;`, updating the table will result in an error.
> ERROR: cannot update table "table1"
> DETAIL: The column list used by the publication does not cover the replica identity.
> So, is there any solution to this problem, or is there a better approach to
> accelerate the conversion efficiency of the CSI columnar index.

I cannot help with that CSI thing.

The only workaround I can think of is to create an index on the publisher that
contains all the columns you need in the replica identity and then using
that with ALTER TABLE ... REPLICA IDENTITY USING INDEX ...

Yours,
Laurenz Albe

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Jon Zeppieri 2025-07-18 20:29:24 Possible causes of high_replay lag, given replication settings?
Previous Message Laurenz Albe 2025-07-18 13:34:28 Re: PgBouncer Prepared Statement ERROR