RE: Perform streaming logical transactions by background workers and parallel apply

From: "houzj(dot)fnst(at)fujitsu(dot)com" <houzj(dot)fnst(at)fujitsu(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: Peter Smith <smithpb2250(at)gmail(dot)com>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, "wangw(dot)fnst(at)fujitsu(dot)com" <wangw(dot)fnst(at)fujitsu(dot)com>, Dilip Kumar <dilipbalaut(at)gmail(dot)com>, "shiy(dot)fnst(at)fujitsu(dot)com" <shiy(dot)fnst(at)fujitsu(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: RE: Perform streaming logical transactions by background workers and parallel apply
Date: 2022-12-26 04:22:41
Message-ID: OS0PR01MB57166C4E79559C9A5570838C94EC9@OS0PR01MB5716.jpnprd01.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Friday, December 23, 2022 5:20 PM houzj(dot)fnst(at)fujitsu(dot)com <houzj(dot)fnst(at)fujitsu(dot)com> wrote:
>
> I noticed a CFbot failure in one of the new testcases in 015_stream.pl which
> comes from old 032_xx.pl. It's because I slightly adjusted the change size in a
> transaction in last version which cause the transaction's size not to exceed the
> decoding work mem, so the transaction is not being applied as expected as
> streaming transactions(it is applied as a non-stremaing transaction) which cause
> the failure. Attach the new version patch which fixed this miss.
>

Since the GUC used to force stream changes has been committed, I removed that
patch from the patch set here and rebased the testcases based on that commit.
Here is the rebased patch set.

Best regards,
Hou zj

Attachment Content-Type Size
v67-0006-Add-a-main_worker_pid-to-pg_stat_subscription.patch application/octet-stream 9.5 KB
v67-0001-Perform-streaming-logical-transactions-by-parall.patch application/octet-stream 214.7 KB
v67-0002-Test-streaming-parallel-option-in-tap-test.patch application/octet-stream 75.7 KB
v67-0003-Add-GUC-stream_serialize_threshold-and-test-seri.patch application/octet-stream 12.2 KB
v67-0004-Stop-extra-worker-if-GUC-was-changed.patch application/octet-stream 4.6 KB
v67-0005-Retry-to-apply-streaming-xact-only-in-apply-work.patch application/octet-stream 21.2 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Anton A. Melnikov 2022-12-26 06:22:08 Re: [BUG] pg_upgrade test fails from older versions.
Previous Message Michael Paquier 2022-12-26 02:52:29 Re: [BUG] pg_upgrade test fails from older versions.