Re: Skipping logical replication transactions on subscriber side

From: Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: "houzj(dot)fnst(at)fujitsu(dot)com" <houzj(dot)fnst(at)fujitsu(dot)com>, Alexey Lesovsky <lesovsky(at)gmail(dot)com>, Peter Eisentraut <peter(dot)eisentraut(at)enterprisedb(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Skipping logical replication transactions on subscriber side
Date: 2021-08-03 06:49:23
Message-ID: CAD21AoC4bvqfJwrhEbyd=0Dm8gg4CwP-K_P_qjchAejfO6UnDg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Mon, Aug 2, 2021 at 12:21 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
>
> On Mon, Aug 2, 2021 at 7:45 AM Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> wrote:
> >
> > On Fri, Jul 30, 2021 at 12:52 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
> > >
> > > On Thu, Jul 29, 2021 at 11:18 AM Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> wrote:
> > >
> > > Setting up logical rep error context in a generic function looks a bit
> > > odd to me. Do we really need to set up error context here? I
> > > understand we can't do this in caller but anyway I think we are not
> > > sending this to logical replication view as well, so not sure we need
> > > to do it here.
> >
> > Yeah, I'm not convinced of this part yet. I wanted to show relid also
> > in truncate cases but I came up with only this idea.
> >
> > If an error happens during truncating the table (in
> > ExecuteTruncateGuts()), relid set by
> > set_logicalrep_error_context_rel() is actually sent to the view. If we
> > don’t have it, the view always shows relid as NULL in truncate cases.
> > On the other hand, it doesn’t cover all cases. For example, it doesn’t
> > cover an error that the target table doesn’t exist on the subscriber,
> > which happens when opening the target table. Anyway, in most cases,
> > even if relid is NULL, the error message in the view helps users to
> > know which relation the error happened on. What do you think?
> >
>
> Yeah, I also think at this stage error message is sufficient in such cases.

I've attached new patches that incorporate all comments I got so far.
Please review them.

Regards,

--
Masahiko Sawada
EDB: https://www.enterprisedb.com/

Attachment Content-Type Size
v5-0004-Add-skip_xid-option-to-ALTER-SUBSCRIPTION.patch application/octet-stream 36.6 KB
v5-0003-Add-RESET-command-to-ALTER-SUBSCRIPTION-command.patch application/octet-stream 15.3 KB
v5-0001-Add-errcontext-to-errors-happening-during-applyin.patch application/octet-stream 14.1 KB
v5-0002-Add-pg_stat_subscription_errors-statistics-view.patch application/octet-stream 48.3 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Simon Riggs 2021-08-03 06:57:37 Re: Lowering the ever-growing heap->pd_lower
Previous Message Nitin Jadhav 2021-08-03 06:48:10 Re: when the startup process doesn't (logging startup delays)