Re: Perform streaming logical transactions by background workers and parallel apply

From: Peter Smith <smithpb2250(at)gmail(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: "houzj(dot)fnst(at)fujitsu(dot)com" <houzj(dot)fnst(at)fujitsu(dot)com>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, "wangw(dot)fnst(at)fujitsu(dot)com" <wangw(dot)fnst(at)fujitsu(dot)com>, Dilip Kumar <dilipbalaut(at)gmail(dot)com>, "shiy(dot)fnst(at)fujitsu(dot)com" <shiy(dot)fnst(at)fujitsu(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Perform streaming logical transactions by background workers and parallel apply
Date: 2022-12-20 06:22:32
Message-ID: CAHut+PtY5M3n_d+sAiQv_1e3_q6mvAemezQ-eR0EZ_jP4emuQg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Tue, Dec 20, 2022 at 2:20 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
>
> On Tue, Dec 20, 2022 at 8:17 AM Peter Smith <smithpb2250(at)gmail(dot)com> wrote:
> >
> > Summary
> > -------
> >
> > In summary, everything I have tested so far appeared to be working
> > properly. In other words, for overlapping streamed transactions of
> > different kinds, and regardless of whether zero/some/all of those
> > transactions are getting processed by a PA worker, the resulting
> > replicated data looked consistently OK.
> >
>
> Thanks for doing the detailed testing of this patch. I think the one
> area where we can focus more is the switch-to-serialization mode while
> sending changes to the parallel worker.
>
> >
> > NOTE - all testing described in this post above was using v58-0001
> > only. However, the point of implementing these as a .spec test was to
> > be able to repeat these same regression tests on newer versions with
> > minimal manual steps required. Later I plan to fetch/apply the most
> > recent patch version and repeat these same tests.
> >
>
> That would be really helpful.
>

FYI, my pub-sub.spec tests gave the same result (i.e. pass) when
re-run against the latest v62-0001 (parallel apply base patch) and
v62-0004 (GUC 'force_stream_mode' patch).

------
Kind Regards,
Peter Smith.
Fujitsu Australia

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message John Naylor 2022-12-20 07:20:20 Re: code cleanups
Previous Message John Naylor 2022-12-20 06:09:37 Re: [PoC] Improve dead tuple storage for lazy vacuum