Re: Conflict detection for update_deleted in logical replication

From: Dilip Kumar <dilipbalaut(at)gmail(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: shveta malik <shveta(dot)malik(at)gmail(dot)com>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, "Zhijie Hou (Fujitsu)" <houzj(dot)fnst(at)fujitsu(dot)com>, "Hayato Kuroda (Fujitsu)" <kuroda(dot)hayato(at)fujitsu(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>, vignesh C <vignesh21(at)gmail(dot)com>, Nisha Moond <nisha(dot)moond412(at)gmail(dot)com>
Subject: Re: Conflict detection for update_deleted in logical replication
Date: 2025-08-07 12:35:09
Message-ID: CAFiTN-s3TSEj+TduSx-2y2JahgMZkp9eaFgZC_bOaN04Bq4TMQ@mail.gmail.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Mon, Aug 4, 2025 at 3:11 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
>
> On Mon, Aug 4, 2025 at 11:46 AM shveta malik <shveta(dot)malik(at)gmail(dot)com> wrote:
> >
> > 7)
> > Shall we rename 'max_conflict_retention_duration' to
> > 'max_conflict_info_retention_duration' as the latter one is more
> > clear?
> >
>
> Before bikeshedding on the name of this option, I would like us to
> once again consider whether we should provide this option at
> subscription-level or GUC?
>
> The rationale behind considering it as a subscription option is that
> the different subscriptions may have different requirements for dead
> tuple retention which means that for some particular subscription, the
> workload may not be always high which means that even if temporarily
> the lag_duration (of apply) has exceeded the new option's value, it
> should become okay. So, in such a case users may not want to configure
> max_conflict_retention_duration for a subscription which would
> otherwise lead to stop detection of update_deleted conflict for that
> subscription.

Yes valid point, and it's also possible that for some subscription
user is okay to not retain dead tuple if it crosses certain duration
OTOH for some subscription it is too critical to retain dead tuple
even if user has to take some performance hit, so might want to have
higher threshold for those slots.

> The other point is that it is only related to the retain_dead_tuples
> option of the subscription, so providing this new option at the same
> level would appear consistent.

Yes that's a valid argument, because if the user is setting retain
dead tuples for subscription then only they need to consider setting
duration.

> I remember that previously Sawada-San has advocated it to provide as
> GUC but I think the recent tests suggest that users should define
> pub-sub topology carefuly to enable retain_dead_tuples option as even
> mentioned in docs[2], so, it is worth considering to provide it at
> subscription-level.

IMHO, it should be fine to provide the subscription option first and
if we see complaints about inconvenience we may consider GUC as well
in the future.

--
Regards,
Dilip Kumar
Google

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Kirill Reshke 2025-08-07 13:01:11 Allow REPLICA IDENTITY with CREATE TABLE statement
Previous Message Daniel Gustafsson 2025-08-07 12:17:43 Re: Bug in pg_dump --filter? - Invalid object types can be misinterpreted as valid