Re: [HACKERS] logical decoding of two-phase transactions

From: Ajin Cherian <itsajin(at)gmail(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: Dilip Kumar <dilipbalaut(at)gmail(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [HACKERS] logical decoding of two-phase transactions
Date: 2020-09-28 07:42:56
Message-ID: CAFPTHDbKNo=y1r9Px34h4iqSqpNR+nWLFAjdzwTb2ybcoXKtnw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, Sep 23, 2020 at 2:39 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:

> No problem. I think you can handle the other comments and then we can
> come back to this and you might want to share the exact details of the
> test (may be a narrow down version of the original test) and I or
> someone else might be able to help you with that.
>
> --
> With Regards,
> Amit Kapila.

I have added a new patch for supporting 2 phase commit semantics in
the streaming APIs for the logical decoding plugins. I have added 3
APIs
1. stream_prepare
2. stream_commit_prepared
3. stream_abort_prepared

I have also added the support for the new APIs in test_decoding
plugin. I have not yet added it to pgoutpout.

I have also added a fix for the error I saw while calling
ReorderBufferCleanupTXN as part of FinishPrepared handling. As a
result I have removed the function I added earlier,
ReorderBufferCleanupPreparedTXN.
Please have a look at the new changes and let me know what you think.

I will continue to look at:

1. Remove snapshots on prepare truncate.
2. Bug seen while abort of prepared transaction, the prepared flag is
lost, and not able to make out that it was a previously prepared
transaction.

regards,
Ajin Cherian
Fujitsu Australia

Attachment Content-Type Size
v6-0001-Support-decoding-of-two-phase-transactions.patch application/octet-stream 66.8 KB
v6-0002-Tap-test-to-test-concurrent-aborts-during-2-phase.patch application/octet-stream 6.2 KB
v6-0004-Support-two-phase-commits-in-streaming-mode-in-lo.patch application/octet-stream 19.5 KB
v6-0003-pgoutput-output-plugin-support-for-logical-decodi.patch application/octet-stream 22.5 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message tsunakawa.takay@fujitsu.com 2020-09-28 08:07:40 RE: [Patch] Optimize dropping of relation buffers using dlist
Previous Message Michael Paquier 2020-09-28 07:33:30 __pg_log_level in anonynous enum should be initialized? (Was: pgsql: Change SHA2 implementation based on OpenSSL to use EVP digest ro)