Re: Teach pg_receivewal to use lz4 compression

From: Magnus Hagander <magnus(at)hagander(dot)net>
To: gkokolatos(at)pm(dot)me
Cc: Dilip Kumar <dilipbalaut(at)gmail(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Teach pg_receivewal to use lz4 compression
Date: 2021-07-01 13:58:24
Message-ID: CABUevEzuc02iacteSq78A7ws6gP7k7TSSG4FHum6uBq8+xTNig@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Thu, Jul 1, 2021 at 3:39 PM <gkokolatos(at)pm(dot)me> wrote:
>
>
>
> ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
>
> On Thursday, July 1st, 2021 at 12:28, Magnus Hagander <magnus(at)hagander(dot)net> wrote:
>
> > On Wed, Jun 30, 2021 at 8:34 AM Dilip Kumar dilipbalaut(at)gmail(dot)com wrote:
> >
> > > On Tue, Jun 29, 2021 at 8:15 PM gkokolatos(at)pm(dot)me wrote:
> > >
> > > > Hi,
> > > >
> > > > The program pg_receivewal can use gzip compression to store the received WAL.
> > > >
> > > > This patch teaches it to be able to use lz4 compression if the binary is build
> > > >
> > > > using the -llz4 flag.
> > >
> > > +1 for the idea
> > >
> > > Some comments/suggestions on the patch
> > >
> > > @@ -90,7 +91,8 @@ usage(void)
> > >
> > > printf((" --synchronous flush write-ahead log immediately
> > >
> > > after writing\n"));
> > >
> > > printf((" -v, --verbose output verbose messages\n"));
> > >
> > > printf(_(" -V, --version output version information, then exit\n"));
> > >
> > > - printf(_(" -Z, --compress=0-9 compress logs with given
> > >
> > > compression level\n"));
> > >
> > > - printf(_(" -I, --compress-program use this program for compression\n"));
> > >
> > > Wouldn't it be better to call it compression method instead of
> > >
> > > compression program?
> >
> > I came here to say exactly that, just had to think up what I thought
> >
> > was the better name first. Either method or algorithm, but method
> >
> > seems like the much simpler choice and therefore better in this case.
> >
> > Should is also then not be --compression-method, rather than --compress-method?
>
> Not a problem. To be very transparent, I first looked what was already out there.
> For example `tar` is using
> -I, --use-compress-program=PROG
> yet the 'use-' bit would push the alignment of the --help output, so I removed it.

I think the difference there is that tar actually calls an external
program to do the work... And we are using the built-in library,
right?

--
Magnus Hagander
Me: https://www.hagander.net/
Work: https://www.redpill-linpro.com/

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Greg Sabino Mullane 2021-07-01 14:03:10 Mention --enable-tap-tests in the TAP section page
Previous Message gkokolatos 2021-07-01 13:39:29 Re: Teach pg_receivewal to use lz4 compression