Re: patch to allow disable of WAL recycling

From: Jerry Jelinek <jerry(dot)jelinek(at)joyent(dot)com>
To: Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>
Cc: Andres Freund <andres(at)anarazel(dot)de>, Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, Peter Eisentraut <peter(dot)eisentraut(at)2ndquadrant(dot)com>, Robert Haas <robertmhaas(at)gmail(dot)com>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: patch to allow disable of WAL recycling
Date: 2018-08-24 22:11:58
Message-ID: CACPQ5FoKi0L7qwS-i3bGnRBTHF-u3VZ9mr-_OmR3pqqXB-ij+g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Alvaro,

I have previously posted ZFS numbers for SmartOS and FreeBSD to this
thread, although not with the exact same benchmark runs that Tomas did.

I think the main purpose of running the benchmarks is to demonstrate that
there is no significant performance regression with wal recycling disabled
on a COW filesystem such as ZFS (which might just be intuitive for a COW
filesystem). I've tried to be sure it is clear in the doc change with this
patch that this tunable is only applicable to COW filesystems. I do not
think the benchmarks will be able to recreate the problematic performance
state that was originally described in Dave's email thread here:

https://www.postgresql.org/message-id/flat/CACukRjO7DJvub8e2AijOayj8BfKK3XXBTwu3KKARiTr67M3E3w%40mail(dot)gmail(dot)com#CACukRjO7DJvub8e2AijOayj8BfKK3XXBTwu3KKARiTr67M3E3w(at)mail(dot)gmail(dot)com

Thanks,
Jerry

On Wed, Aug 22, 2018 at 8:41 AM, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>
wrote:

> On 2018-Aug-22, Andres Freund wrote:
>
> > On 2018-08-22 11:06:17 -0300, Alvaro Herrera wrote:
>
> > > I suppose that the use case that was initially proposed (ZFS) has not
> > > yet been tested so we shouldn't reject this patch immediately, but
> > > perhaps what Joyent people should be doing now is running Tomas' test
> > > script on ZFS and see what the results look like.
> >
> > IDK, I would see it less negatively. Yes, we should put a BIG FAT
> > warning to never use this on non COW filesystems. And IMO ZFS (and also
> > btrfs) sucks badly here, even though they really shouldn't. But given
> > the positive impact for zfs & btrfs, and the low code complexity, I
> > think it's not insane to provide this tunable.
>
> Yeah, but let's see some ZFS numbers first :-)
>
> --
> Álvaro Herrera https://www.2ndQuadrant.com/
> PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
>

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruce Momjian 2018-08-24 22:21:48 Re: Compile failures today
Previous Message Fabien COELHO 2018-08-24 22:06:30 Re: libpq host/hostaddr/conninfo inconsistencies