Re: PATCH: logical_work_mem and logical streaming of large in-progress transactions

From: Dilip Kumar <dilipbalaut(at)gmail(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: Michael Paquier <michael(at)paquier(dot)xyz>, Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, Peter Eisentraut <peter(dot)eisentraut(at)2ndquadrant(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: PATCH: logical_work_mem and logical streaming of large in-progress transactions
Date: 2020-02-29 05:07:44
Message-ID: CAFiTN-uNzEyY3YL1EZabWcG=Bah1nO8hno+-UaAkCDcfCGYC0g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Thu, Feb 13, 2020 at 8:42 AM Dilip Kumar <dilipbalaut(at)gmail(dot)com> wrote:
>
> On Tue, Feb 11, 2020 at 8:42 AM Dilip Kumar <dilipbalaut(at)gmail(dot)com> wrote:
>
> The patch set was not applying on the head so I have rebased it.

I have changed the patch 0002 so that instead of logging the WAL for
each invalidation, now we log at each command end as discussed
upthread[1]

Soon we will evaluate the performance for the same and post the results.

[1] https://www.postgresql.org/message-id/CAA4eK1LOa%2B2KqNX%3Dm%3D1qMBDW%2Bo50AuwjAOX6ZqL-rWGiH1F9MQ%40mail.gmail.com

--
Regards,
Dilip Kumar
EnterpriseDB: http://www.enterprisedb.com

Attachment Content-Type Size
v12-0001-Immediately-WAL-log-assignments.patch application/octet-stream 10.3 KB
v12-0002-Issue-individual-invalidations-with-wal_level-lo.patch application/octet-stream 17.9 KB
v12-0005-Implement-streaming-mode-in-ReorderBuffer.patch application/octet-stream 37.8 KB
v12-0003-Extend-the-output-plugin-API-with-stream-methods.patch application/octet-stream 34.8 KB
v12-0004-Gracefully-handle-concurrent-aborts-of-uncommitt.patch application/octet-stream 12.6 KB
v12-0007-Track-statistics-for-streaming.patch application/octet-stream 11.7 KB
v12-0006-Add-support-for-streaming-to-built-in-replicatio.patch application/octet-stream 89.8 KB
v12-0008-Enable-streaming-for-all-subscription-TAP-tests.patch application/octet-stream 14.7 KB
v12-0009-Add-TAP-test-for-streaming-vs.-DDL.patch application/octet-stream 4.4 KB
v12-0010-Bugfix-handling-of-incomplete-toast-tuple.patch application/octet-stream 13.3 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message David Zhang 2020-02-29 05:23:49 Re: Making psql error out on output failures
Previous Message Masahiko Sawada 2020-02-29 03:36:30 Re: Some problems of recovery conflict wait events