Re: Logical replication CPU-bound with TRUNCATE/DROP/CREATE many tables

From: Dilip Kumar <dilipbalaut(at)gmail(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: Simon Riggs <simon(at)2ndquadrant(dot)com>, Keisuke Kuroda <keisuke(dot)kuroda(dot)3862(at)gmail(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Logical replication CPU-bound with TRUNCATE/DROP/CREATE many tables
Date: 2020-10-14 11:21:24
Message-ID: CAFiTN-sRs6jJUFuBd_H3XyhVCp8J7PpVSaRnJacRxGQQbjb7rg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, Oct 14, 2020 at 4:12 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
>
> On Mon, Oct 12, 2020 at 3:23 PM Dilip Kumar <dilipbalaut(at)gmail(dot)com> wrote:
> >
> > On Fri, Oct 9, 2020 at 2:34 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
> > >
> > >
> > > Okay, I think this makes sense. I think we should see the performance
> > > benefit for this case as well but maybe to a bit lesser degree because
> > > we will exclude some of the subtransactions from processing.
> >
> > I have tried with a combination of abort/commit subtransaction and I
> > could see a similar benefit with the patch.
> >
> > I tested below transaction
> > BEGIN;
> > truncate table nsp_001.tbl_001;
> > savepoint s1;
> > truncate table nsp_001.tbl_001;
> > savepoint s2;
> > truncate table part_0001;
> > savepoint s3;
> > truncate table part_0002;
> > savepoint s5;
> > truncate table part_0003;
> > rollback to s3;
> > commit;
> > EOF
> >
>
> Thanks for the tests. The latest patch looks mostly good to me. I have
> made minor changes to the patch (a) changed the order where the new
> message is placed at one place to make it consistent with other
> places, (b) as discussed offlist, removed the extra increment to a
> local variable in ReorderBufferRestoreChange, (c) ran pgindent.
>
> See the attached and let me know what do you think?

The changes look good to me.

--
Regards,
Dilip Kumar
EnterpriseDB: http://www.enterprisedb.com

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Bharath Rupireddy 2020-10-14 11:35:07 Re: Parallel copy
Previous Message Amit Kapila 2020-10-14 10:42:20 Re: Logical replication CPU-bound with TRUNCATE/DROP/CREATE many tables