Re: [CAUTION: SUSPECT SENDER] RE: [CAUTION: SUSPECT SENDER] RE: BUG #19029: Replication Slot size keeps increasing while logical subscription works fine

From: Thadeus Anand <thadeus(at)rmkv(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: "Hayato Kuroda (Fujitsu)" <kuroda(dot)hayato(at)fujitsu(dot)com>, "pgsql-bugs(at)lists(dot)postgresql(dot)org" <pgsql-bugs(at)lists(dot)postgresql(dot)org>, vignesh C <vignesh21(at)gmail(dot)com>, "Nantha kumar(dot)T(dot)" <nanthad(at)gmail(dot)com>
Subject: Re: [CAUTION: SUSPECT SENDER] RE: [CAUTION: SUSPECT SENDER] RE: BUG #19029: Replication Slot size keeps increasing while logical subscription works fine
Date: 2025-08-27 05:31:44
Message-ID: CANUywMGfVd-mJPOW+YT3Kcerc4xCY3ZJqBLcD7Zi5vqTjEL1BQ@mail.gmail.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

Hi,

Thank you everyone for your wonderful guidance. Really appreciate it.

I have a couple of doubts.

Can these spill files in the pg_replslot folder be deleted safely, if all
the subscribers have caught up? (I noticed last night when I restarted my
publisher, the spill files were removed automatically)

Can I use ALTER SUBSCRIPTION to set streaming on, with my existing
subscriptions?

Thadeus.

On Wed, Aug 27, 2025 at 10:06 AM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
wrote:

> On Wed, Aug 27, 2025 at 9:09 AM Hayato Kuroda (Fujitsu)
> <kuroda(dot)hayato(at)fujitsu(dot)com> wrote:
> >
> > Dear Thadeus,
> >
> > > I do not know or understand what a "spill" is.
> >
> > As I wrote in a previous mail, logical decoding (and logical replication)
> > sometimes writes changes into the disk to avoid using too-much memory,
> and the
> > ".spill" file is the fragment. This can happen when the total amount of
> decoded
> > changes exceeds logical_decoding_work_mem.
> >
> > > I will look it up. But the tables that are part of the
> > > publication are not updated as part of any huge transaction. They may
> be part of some other
> > > long running procedures
> >
> > Actually, logical decoding decodes all changes even if tables are not
> published,
> > and suppress outputting changes at commit phase.
> >
>
> One can avoid the generation of so many spill files for large
> transactions by using streaming=on or streaming=parallel while
> creating subscriptions.
>
> --
> With Regards,
> Amit Kapila.
>

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message Nantha kumar.T. 2025-08-27 06:30:59 Re: [CAUTION: SUSPECT SENDER] RE: [CAUTION: SUSPECT SENDER] RE: BUG #19029: Replication Slot size keeps increasing while logical subscription works fine
Previous Message Amit Kapila 2025-08-27 04:36:32 Re: [CAUTION: SUSPECT SENDER] RE: [CAUTION: SUSPECT SENDER] RE: BUG #19029: Replication Slot size keeps increasing while logical subscription works fine