Re: pg_basebackup's --gzip switch misbehaves

From: Justin Pryzby <pryzby(at)telsasoft(dot)com>
To: Michael Paquier <michael(at)paquier(dot)xyz>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: pg_basebackup's --gzip switch misbehaves
Date: 2022-09-22 03:37:16
Message-ID: 20220922033716.GL31833@telsasoft.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Thu, Sep 22, 2022 at 10:25:11AM +0900, Michael Paquier wrote:
> On Wed, Sep 21, 2022 at 07:31:48PM -0500, Justin Pryzby wrote:
> > I think at some point (maybe before releasing 1.3.4) the range was
> > increased to very large(small), negative levels. It's possible to query
> > the library about the lowest supported compression level, but then
> > there's a complication regarding the client-side library version vs the
> > server-side version. So it seems better to just use -7.
>
> Indeed. Contrary to the default level, there are no variables for the
> minimum and maximum levels. As you are pointing out, a lookup at
> zstd_compress.c shows that we have ZSTD_minCLevel() and
> ZSTD_maxCLevel() that assign the bounds. Both are available since
> 1.4.0. We still need a backend-side check as the level passed with a
> BASE_BACKUP command would be only validated there. It seems to me
> that this is going to be less of a headache in the long-term if we
> just use those routines at runtime, as zstd wants to keep some freedom
> with the min and max bounds for the compression level, at least that's
> the flexibility that this gives the library. So I would tweak things
> as the attached.

Okay. Will that complicate tests at all? It looks like it's not an
issue for the tests currently proposed in the CF APP.
https://commitfest.postgresql.org/39/3835/

However the patch ends up, +0.75 to backpatch it to v15 rather than
calling it a new feature in v16.

--
Justin

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2022-09-22 03:43:56 Re: pg_basebackup's --gzip switch misbehaves
Previous Message wangw.fnst@fujitsu.com 2022-09-22 03:36:02 RE: [PATCH] Use indexes on the subscriber when REPLICA IDENTITY is full on the publisher