Re: pg_dump performance

From: Heikki Linnakangas <heikki(at)enterprisedb(dot)com>
To: Jared Mauch <jared(at)puck(dot)nether(dot)net>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: pg_dump performance
Date: 2007-12-26 20:52:08
Message-ID: 4772BEF8.2030509@enterprisedb.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Jared Mauch wrote:
> pg_dump is utilizing about 13% of the cpu and the
> corresponding postgres backend is at 100% cpu time.
> (multi-core, multi-cpu, lotsa ram, super-fast disk).
> ...
> Any tips on getting pg_dump (actually the backend) to perform
> much closer to 500k/sec or more? This would also aide me when I upgrade
> pg versions and need to dump/restore with minimal downtime (as the data
> never stops coming.. whee).

I would suggest running oprofile to see where the time is spent. There
might be some simple optimizations that you could do at the source level
that would help.

Where the time is spent depends a lot on the schema and data. For
example, I profiled a pg_dump run on a benchmark database a while ago,
and found that most of the time was spent in sprintf, formatting
timestamp columns. If you have a lot of timestamp columns that might be
the bottleneck for you as well, or something else.

Or if you can post the schema for the table you're dumping, maybe we can
make a more educated guess.

--
Heikki Linnakangas
EnterpriseDB http://www.enterprisedb.com

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Fernando Hevia 2007-12-26 20:52:27 Re: With 4 disks should I go for RAID 5 or RAID 10
Previous Message Jared Mauch 2007-12-26 20:22:30 pg_dump performance