Re: Re: [SQL] Re: [GENERAL] lztext and compression ratios...

From: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
To: Jan Wieck <JanWieck(at)Yahoo(dot)com>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, PostgreSQL HACKERS <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Re: [SQL] Re: [GENERAL] lztext and compression ratios...
Date: 2000-07-10 21:32:35
Message-ID: 200007102132.RAA03602@candle.pha.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-sql

> Compressor | level | heap size | toastrel | toastidx | seconds
> | | | size | size |
> -----------+-------+-----------+----------+----------+--------
> PGLZ | - | 425,984 | 950,272 | 32,768 | 5.20
> zlib | 1 | 499,712 | 614,400 | 16,384 | 6.85
> zlib | 3 | 499,712 | 557,056 | 16,384 | 6.75
> zlib | 6 | 491,520 | 524,288 | 16,384 | 7.10
> zlib | 9 | 491,520 | 524,288 | 16,384 | 7.21

Consider that the 25% slowness gets us a 35% disk reduction, and that
translates to fewer buffer blocks and disk accesses. Seems there is a
clear tradeoff there.

> If replacing the compressor/decompressor can cause a runtime
> difference of 25% in such a scenario, the pure difference
> between the two methods must be alot.
>
> Leave PGLZ in place as the default compressor for toastable
> types. Speed is what all benchmarks talk about - on disk
> storage size is seldom a minor note.

True, disk storage is not the issue, but disk access are an issue.

> We can discuss about enabling zlib as a per attribute
> configurable alternative further. But is the confusion this
> might cause worth it all?

I think we have to choose one proposal.

--
Bruce Momjian | http://candle.pha.pa.us
pgman(at)candle(dot)pha(dot)pa(dot)us | (610) 853-3000
+ If your life is a hard drive, | 830 Blythe Avenue
+ Christ can be your backup. | Drexel Hill, Pennsylvania 19026

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Bruce Momjian 2000-07-10 21:38:38 Re: Re: [GENERAL] PostgreSQL vs. MySQL
Previous Message Giulio Orsero 2000-07-10 21:14:42 Re: Another mySQL to PostgreSQL move question

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruce Momjian 2000-07-10 21:38:38 Re: Re: [GENERAL] PostgreSQL vs. MySQL
Previous Message Bruce Momjian 2000-07-10 19:01:20 Re: AW: Re: postgres TODO

Browse pgsql-sql by date

  From Date Subject
Next Message Ed 2000-07-10 21:58:36 Error : Unknown address family (0)
Previous Message Ed Loehr 2000-07-10 21:31:08 Re: Re: Matching and Scoring with multiple fields