Re: Re: [SQL] Re: [GENERAL] lztext and compression ratios...

From: eisentrp(at)csis(dot)gvsu(dot)edu
To: Jan Wieck <JanWieck(at)yahoo(dot)com>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, PostgreSQL HACKERS <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Re: [SQL] Re: [GENERAL] lztext and compression ratios...
Date: 2000-07-07 13:14:07
Message-ID: Pine.LNX.4.21.0007070911430.12287-100000@eos05.csis.gvsu.edu
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-sql

Maybe you just want to use zlib. Let other guys hammer out the details.

On Thu, 6 Jul 2000, Jan Wieck wrote:

> While writing it I noticed that the algorithm is really
> expensive for big items. The history lookup table allocated
> is 8 times (on 32 bit architectures) the size of the input.
> So if you want to have 1MB compressed, it'll allocate 8MB for
> the history. It hit me when I was hunting a bug in the
> toaster earlier today. Doing an update to a toasted item of
> 5MB, resulting in a new value of 10MB, the backend blew up to
> 290MB of virtual memory - oh boy. I definitely need to make
> that smarter.
>
> When I wrote it I never thought about items that big. It was
> before we had the idea of TOAST.
>
> This all might open another discussion I'll start in a
> separate thread.
>
>
> Jan
>
> --
>
> #======================================================================#
> # It's easier to get forgiveness for being wrong than for being right. #
> # Let's break this rule - forgive me. #
> #================================================== JanWieck(at)Yahoo(dot)com #
>
>
>

--
Peter Eisentraut Sernanders vaeg 10:115
peter_e(at)gmx(dot)net 75262 Uppsala
http://yi.org/peter-e/ Sweden

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Thomas Lockhart 2000-07-07 13:47:29 Re: Find all the dates in the calendar week?
Previous Message The Hermit Hacker 2000-07-07 12:44:20 Re: PostgreSQL & the BSD License

Browse pgsql-hackers by date

  From Date Subject
Next Message Karel Zak 2000-07-07 13:33:50 Re: DateStyle (was Re: Per-database/schema settings)
Previous Message Karel Zak 2000-07-07 13:09:30 Re: Per-database/schema settings

Browse pgsql-sql by date

  From Date Subject
Next Message Thomas Swan 2000-07-07 13:46:52 Altnerate Column Return Names
Previous Message DalTech - Continuing Technical Education 2000-07-07 12:44:53 Re: MAX() of 0 records.