RE: Conflict detection for update_deleted in logical replication

From: "Zhijie Hou (Fujitsu)" <houzj(dot)fnst(at)fujitsu(dot)com>
To: "Zhijie Hou (Fujitsu)" <houzj(dot)fnst(at)fujitsu(dot)com>, shveta malik <shveta(dot)malik(at)gmail(dot)com>
Cc: Dilip Kumar <dilipbalaut(at)gmail(dot)com>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, "Hayato Kuroda (Fujitsu)" <kuroda(dot)hayato(at)fujitsu(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>, vignesh C <vignesh21(at)gmail(dot)com>, Nisha Moond <nisha(dot)moond412(at)gmail(dot)com>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>
Subject: RE: Conflict detection for update_deleted in logical replication
Date: 2025-08-07 04:39:53
Message-ID: OS0PR01MB57168CACCF3CA238FC11DC4B942CA@OS0PR01MB5716.jpnprd01.prod.outlook.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Tuesday, August 5, 2025 10:09 AM Zhijie Hou (Fujitsu) <houzj(dot)fnst(at)fujitsu(dot)com> wrote:
> Here is V57 patch set which addressed most of comments.
>
> In this version, I also fixed a bug that the apply worker continued to find dead
> tuples even if it has already stop retaining dead tuples.

Here is a V58 patch set which improved few things by internal review:

0001:

* Remove the slot invalidation.

Initially, we thought it would be convenient for users to determine if they can
reliably detect update_deleted by checking the validity of the conflict
detection slot. However, after re-thinking, even if the slot is valid, it
doesn't guarantee that each apply worker can reliably detect conflicts. Some
apply workers might have stopped retention, yet the slot remains valid due to
other active workers continuing retention.

Instead of querying the slot, users should verify the ability of a specific
apply worker to reliably detect conflicts by checking the view
pg_stat_subscription.retain_dead_tuples.

So, slot invalidation would be necessary. We could set slot.xmin to invalid
instead to allow dead tuples to be removed when all apply workers stop
retention. This approach simplifies implementation and avoids introducing a new
invalidation type solely for one internal slot.

* Fixed a bug that parallel apply worker continues to search dead tuples when
the retention has already stopped. The parallel and table sync worker referred
to its own stop_conflict_info_retention flag, but should refer to the
retention flag of the leader instead because only leader mananges this flag.

0002:

* Allow the apply worker to wait for the slot to be recover after resuming the dead
tuple retention instead of restarting the apply worker.

Best Regards,
Hou zj

Attachment Content-Type Size
v58-0002-Resume-retaining-the-information-for-conflict-de.patch application/octet-stream 13.8 KB
v58-0001-Introduce-a-new-GUC-max_conflict_retention_durat.patch application/octet-stream 26.0 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Pavel Stehule 2025-08-07 04:53:36 Re: event trigger support for PL/Python
Previous Message shveta malik 2025-08-07 03:50:53 Re: Logical Replication of sequences