Re: pg_dump custom format and pigz

From: "Marc Mamin" <M(dot)Mamin(at)intershop(dot)de>
To: "Tino Schwarze" <postgresql(at)tisc(dot)de>, <pgsql-admin(at)postgresql(dot)org>
Subject: Re: pg_dump custom format and pigz
Date: 2009-10-24 12:08:08
Message-ID: C4DAC901169B624F933534A26ED7DF31010A534B@JENMAIL01.ad.intershop.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

>Well, that would mean linking pg_dump with the library providing the compression you want. I suppose, only data is compressed, not the whole dump, e.g. dumping without compression then compressing is different from dumping with compression.

Yep,
I have no skill in C programming, but wouldn't it be a good idea to add/integrate the pigz source in pg_dump ? There is a least no concern to have about the License.
regards,

Marc

-----Original Message-----
From: pgsql-admin-owner(at)postgresql(dot)org [mailto:pgsql-admin-owner(at)postgresql(dot)org] On Behalf Of Tino Schwarze
Sent: Friday, October 23, 2009 4:25 PM
To: pgsql-admin(at)postgresql(dot)org
Subject: Re: [ADMIN] pg_dump custom format and pigz

Hi Marc,

On Fri, Oct 23, 2009 at 03:52:16PM +0200, Marc Mamin wrote:

> > You might add pigz as a post-processing step and disabling compression in pg_dump.
>
> The problem with this solution is that it make it necessary to
> decompress the dump entirely before using pg_restore (or did I miss a
> point ?) This is an issue as our uncompressed dumps may reach 3-500
> GB...

Right, that would not work.

> A better way would be to have a configuration option to tell which
> compression tool should be used internally by pg_dump.

Well, that would mean linking pg_dump with the library providing the compression you want. I suppose, only data is compressed, not the whole dump, e.g. dumping without compression then compressing is different from dumping with compression.

Tino.

--
"What we nourish flourishes." - "Was wir nähren erblüht."

www.lichtkreis-chemnitz.de
www.tisc.de

--
Sent via pgsql-admin mailing list (pgsql-admin(at)postgresql(dot)org) To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin

In response to

Browse pgsql-admin by date

  From Date Subject
Next Message Andreas Schmidt 2009-10-25 15:34:26 pg_standby doesnt't work
Previous Message Scott Marlowe 2009-10-23 22:42:50 Re: upgrading postgres version