Re: Disable WAL logging to speed up data loading

From: Kyotaro Horiguchi <horikyota(dot)ntt(at)gmail(dot)com>
To: sfrost(at)snowman(dot)net
Cc: laurenz(dot)albe(at)cybertec(dot)at, osumi(dot)takamichi(at)fujitsu(dot)com, tsunakawa(dot)takay(at)fujitsu(dot)com, magnus(at)hagander(dot)net, robertmhaas(at)gmail(dot)com, masao(dot)fujii(at)oss(dot)nttdata(dot)com, ashutosh(dot)bapat(dot)oss(at)gmail(dot)com, pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: Disable WAL logging to speed up data loading
Date: 2020-11-20 00:22:05
Message-ID: 20201120.092205.859902419077270372.horikyota.ntt@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

At Thu, 19 Nov 2020 11:04:17 -0500, Stephen Frost <sfrost(at)snowman(dot)net> wrote in
> Greetings,
>
> * Laurenz Albe (laurenz(dot)albe(at)cybertec(dot)at) wrote:
> > On Thu, 2020-11-19 at 05:24 +0000, osumi(dot)takamichi(at)fujitsu(dot)com wrote:
> > > > > > ereport(WARNING,
> > > > > > (errmsg("WAL was generated with wal_level=minimal, data may
> > > > > > be missing"),
> > > > > > errhint("This happens if you temporarily set
> > > > > > wal_level=minimal without taking a new base backup.")));
> > > > > > There's definitely a question about if a WARNING there is really
> > > > > > sufficient or not, considering that you could end up with 'logged'
> > > > > > tables on the replica that are missing data, but I'm not sure that
> > > > > > inventing a new, independent, mechanism for checking WAL level
> > > > > > changes makes
> > > > > sense.
> > > >
> > > > I don't know why WARNING was chosen. I think it should be FATAL,
> > > > resulting in the standby shutdown, disabling restarting it, and urging the user
> > > > to rebuild the standby. (I guess that's overreaction because the user may
> > > > not perform operations that lack WAL while wal_level is minimal.)
> > >
> > > Yeah, I agree that WARNING is not sufficient.
> >
> > I missed that this is only a warning when I looked at it before.
> > Yes, it should be a fatal error.
>
> Yeah, the more that I think about it, the more that I tend to agree with
> this. Does anyone want to argue against changing this into a FATAL..?

I don't come up with a use case where someone needs to set
wal_level=minimal for archive recovery. So +1 to change it to FATAL.

regards.

--
Kyotaro Horiguchi
NTT Open Source Software Center

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message tsunakawa.takay@fujitsu.com 2020-11-20 00:32:38 RE: Disable WAL logging to speed up data loading
Previous Message Peter Geoghegan 2020-11-19 22:51:42 Re: new heapcheck contrib module