Re: Is there anything special about pg_dump's compression?

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Jean-David Beyer <jeandavid8(at)verizon(dot)net>
Cc: pgsql-sql(at)postgresql(dot)org
Subject: Re: Is there anything special about pg_dump's compression?
Date: 2007-11-16 05:29:31
Message-ID: 26036.1195190971@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

Jean-David Beyer <jeandavid8(at)verizon(dot)net> writes:
> I turned the software compression off. It took:
> 524487428 bytes (524 MB) copied, 125.394 seconds, 4.2 MB/s

> When I let the software compression run, it uses only 30 MBytes. So whatever
> compression it uses is very good on this kind of data.
> 29810260 bytes (30 MB) copied, 123.145 seconds, 242 kB/s

Seems to me the conclusion is obvious: you are writing about the same
number of bits to physical tape either way. The physical tape speed is
surely the real bottleneck here, and the fact that the total elapsed
time is about the same both ways proves that about the same number of
bits went onto tape both ways.

The quoted MB and MB/s numbers are not too comparable because they are
before and after compression respectively.

The software compression seems to be a percent or two better than the
hardware's compression, but that's not enough to worry about really.
What you should ask yourself is whether you have other uses for the main
CPU's cycles during the time you're taking backups. If so, offload the
compression cycles onto the tape hardware. If not, you might as well
gain the one or two percent win.

regards, tom lane

In response to

Responses

Browse pgsql-sql by date

  From Date Subject
Next Message Bart Degryse 2007-11-16 07:56:40 Re: trap for any exception
Previous Message Jean-David Beyer 2007-11-16 05:00:56 Re: Is there anything special about pg_dump's compression?