Re: [HACKERS] Custom compression methods

From: Ildus Kurbangaliev <i(dot)kurbangaliev(at)postgrespro(dot)ru>
To: Alexander Korotkov <a(dot)korotkov(at)postgrespro(dot)ru>
Cc: Konstantin Knizhnik <k(dot)knizhnik(at)postgrespro(dot)ru>, Ildar Musin <i(dot)musin(at)postgrespro(dot)ru>, Robert Haas <robertmhaas(at)gmail(dot)com>, Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>, Евгений Шишкин <itparanoia(at)gmail(dot)com>, Andres Freund <andres(at)anarazel(dot)de>, Oleg Bartunov <obartunov(at)gmail(dot)com>, Craig Ringer <craig(at)2ndquadrant(dot)com>, Peter Eisentraut <peter(dot)eisentraut(at)2ndquadrant(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org>, Chapman Flack <chap(at)anastigmatix(dot)net>
Subject: Re: [HACKERS] Custom compression methods
Date: 2018-06-18 14:30:45
Message-ID: 20180618173045.7f734aca@wp.localdomain
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-hackers

On Tue, 24 Apr 2018 14:05:20 +0300
Alexander Korotkov <a(dot)korotkov(at)postgrespro(dot)ru> wrote:

> Yes, this patch definitely lacks of good usage example. That may
> lead to some misunderstanding of its purpose. Good use-cases
> should be shown before we can consider committing this. I think
> Ildus should try to implement at least custom dictionary compression
> method where dictionary is specified by user in parameters.


attached v16 of the patch. I have splitted the patch to 8 parts so now
it should be easier to make a review. The main improvement is zlib
compression method with dictionary support like you mentioned. My
synthetic tests showed that zlib gives more compression but usually
slower than pglz.

Ildus Kurbangaliev
Postgres Professional:
Russian Postgres Company

Attachment Content-Type Size
0001-Make-syntax-changes-for-custom-compression-metho-v16.patch text/x-patch 9.1 KB
0002-Add-compression-catalog-tables-and-the-basic-inf-v16.patch text/x-patch 114.0 KB
0003-Add-rewrite-rules-and-tupdesc-flags-v16.patch text/x-patch 24.4 KB
0004-Add-pglz-compression-method-v16.patch text/x-patch 7.5 KB
0005-Add-zlib-compression-method-v16.patch text/x-patch 9.9 KB
0006-Add-psql-pg_dump-and-pg_upgrade-support-v16.patch text/x-patch 37.5 KB
0007-Add-tests-for-compression-methods-v16.patch text/x-patch 133.5 KB
0008-Add-documentation-for-custom-compression-methods-v16.patch text/x-patch 16.1 KB

In response to


Browse pgsql-hackers by date

  From Date Subject
Next Message Joe Conway 2018-06-18 14:45:37 Re: [Proposal] Table-level Transparent Data Encryption (TDE) and Key Management Service (KMS)
Previous Message Robert Haas 2018-06-18 14:26:43 Re: [Proposal] Table-level Transparent Data Encryption (TDE) and Key Management Service (KMS)