Re: zstd compression for pg_dump

From: Justin Pryzby <pryzby(at)telsasoft(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: zstd compression for pg_dump
Date: 2020-12-22 02:32:35
Message-ID: 20201222023235.GJ30237@telsasoft.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Mon, Dec 21, 2020 at 03:02:40PM -0500, Tom Lane wrote:
> Justin Pryzby <pryzby(at)telsasoft(dot)com> writes:
> > I found that our largest tables are 40% smaller and 20% faster to pipe
> > pg_dump -Fc -Z0 |zstd relative to native zlib
>
> The patch might be a tad smaller if you hadn't included a core file in it.

About 89% smaller.

This also fixes the extension (.zst)
And fixes zlib default compression.
And a bunch of cleanup.

--
Justin

Attachment Content-Type Size
0001-fix-pre-existing-docs-comments.patch text/x-diff 1.8 KB
0002-Fix-malformed-comment.patch text/x-diff 1.2 KB
0003-pg_dump-zstd-compression.patch text/x-diff 30.0 KB
0004-cmdline-parser-for-compression-alg-level-opts.patch text/x-diff 37.7 KB
0005-union-with-a-CompressionAlgorithm-alg.patch text/x-diff 11.5 KB
0006-Move-zlib-into-the-union.patch text/x-diff 4.4 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Kyotaro Horiguchi 2020-12-22 02:37:41 Re: [Patch] Optimize dropping of relation buffers using dlist
Previous Message Masahiro Ikeda 2020-12-22 02:16:43 Re: Add statistics to pg_stat_wal view for wal related parameter tuning