| From: | Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> |
|---|---|
| To: | shveta malik <shveta(dot)malik(at)gmail(dot)com> |
| Cc: | Peter Smith <smithpb2250(at)gmail(dot)com>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, "Hayato Kuroda (Fujitsu)" <kuroda(dot)hayato(at)fujitsu(dot)com>, Ashutosh Bapat <ashutosh(dot)bapat(dot)oss(at)gmail(dot)com>, Shlok Kyal <shlok(dot)kyal(dot)oss(at)gmail(dot)com>, Bertrand Drouvot <bertranddrouvot(dot)pg(at)gmail(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: POC: enable logical decoding when wal_level = 'replica' without a server restart |
| Date: | 2025-11-12 10:06:19 |
| Message-ID: | CAD21AoCWdWESAJu=-Y9y__Zu0K6yDibdRMKKoH3+yQduot_wzQ@mail.gmail.com |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
On Tue, Nov 11, 2025 at 6:05 PM Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> wrote:
>
> On Mon, Nov 10, 2025 at 8:05 PM shveta malik <shveta(dot)malik(at)gmail(dot)com> wrote:
> >
> > On Thu, Nov 6, 2025 at 4:32 AM Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> wrote:
> > >
> > >
> > > I've updated and rebased the patch.
> > >
> >
> > Thanks for the patch. Please find a few comments:
> >
> >
> > 1)
> > ReplicationSlotsDropDBSlots:
> >
> > + SpinLockAcquire(&s->mutex);
> > + invalidated = s->data.invalidated == RS_INVAL_NONE;
> > + SpinLockRelease(&s->mutex);
> > +
> > + /*
> > + * Count slots on other databases too so we can disable logical
> > + * decoding only if no slots in the cluster.
> > + */
> > + if (invalidated)
> > + n_valid_logicalslots++;
> >
> >
> > This seems confusing to me. Can we instead do:
> >
> > SpinLockAcquire(&s->mutex);
> > if (s->data.invalidated == RS_INVAL_NONE)
> > n_valid_logicalslots++;
> > SpinLockRelease(&s->mutex);
> >
> > 2)
> > InvalidateObsoleteReplicationSlots:
> >
> > + bool islogical = SlotIsLogical(s);
> >
> > /* Prevent invalidation of logical slots during binary upgrade */
> > if (SlotIsLogical(s) && IsBinaryUpgrade)
> > + {
> > + SpinLockAcquire(&s->mutex);
> > + if (s->data.invalidated == RS_INVAL_NONE)
> > + n_valid_logicalslots++;
> > + SpinLockRelease(&s->mutex);
> > +
> > continue;
> > + }
> >
> > We should use 'islogical' instead of SlotIsLogical here.
> >
> > 3)
> > InvalidateObsoleteReplicationSlots() is more robust now as we are
> > using both 'invalidated' and 'released_lock' flags but still nowhere
> > we guarantee that invalidated=true implies released_lock=true. Since
> > we jump to 'restart' label only if released_lock is true, it becomes
> > important to have an ASSERT which says invalidated=true implicitly
> > means released_lock=true or vice versa. Because at the end we go by
> > 'invalidated_logical' rather than 'released_lock' to decide about
> > logical-decoding disabling.
> >
> > In this logic:
> >
> > + if (InvalidatePossiblyObsoleteSlot(possible_causes, s, oldestLSN,
> > + dboid, snapshotConflictHorizon,
> > + &released_lock))
> > {
> > - /* if the lock was released, start from scratch */
> > - goto restart;
> > + /* Remember we have invalidated a physical or logical slot */
> > + invalidated = true;
> > +
> > + /*
> > + * Additionally, remember we have invalidated a logical slot too
> > + * as we can request disabling logical decoding later.
> > + */
> > + if (islogical)
> > + invalidated_logical = true;
> > }
> >
> > Shall we have an Assert(released_lock) if
> > InvalidatePossiblyObsoleteSlot returns true. Or any better way?
> >
> > 4)
> > + SpinLockAcquire(&s->mutex);
> > + if (s->data.invalidated == RS_INVAL_NONE)
> > + n_valid_logicalslots++;
> >
> > In the same function, isn't the above code problematic: Don't we need
> > 'islogical' check before incrementing 'n_valid_logicalslots',
> > otherwise it may wrongly count valid physical slots as well.
>
> Agreed with all the above points. Will fix and update the updated version.
>
I've attached the updated version patch. I addressed all comments I
got so far, and made some cosmetic changes.
Regards,
--
Masahiko Sawada
Amazon Web Services: https://aws.amazon.com
| Attachment | Content-Type | Size |
|---|---|---|
| v25-0001-Toggle-logical-decoding-dynamically-based-on-log.patch | application/octet-stream | 110.2 KB |
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Yugo Nagata | 2025-11-12 10:46:40 | Re: Make PQgetResult() not return NULL on out-of-memory error |
| Previous Message | shveta malik | 2025-11-12 09:44:06 | Re: Proposal: Conflict log history table for Logical Replication |