Re: pg_dump / pg_dumpall / memory issues

From: Murthy Kambhampaty <murthy(dot)kambhampaty(at)goeci(dot)com>
To: 'Ericson Smith' <eric(at)did-it(dot)com>, Postgresql General <pgsql-general(at)postgresql(dot)org>
Subject: Re: pg_dump / pg_dumpall / memory issues
Date: 2003-04-10 14:46:29
Message-ID: 2D92FEBFD3BE1346A6C397223A8DD3FC0921E0@THOR.goeci.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

If you have a standby database server, and you are looking to get speedy
backups, you will want to look at:
http://marc.theaimsgroup.com/?l=postgresql-admin&w=2&r=1&s=lvm+snapshots&q=b

The thread discusses filesystem level backup of the database cluster off an
[LVM/EVMS/NetApp] filer snapshot, with implementation details for linux LVM
snapshots.

Cheers,
Murthy

-----Original Message-----
From: Ericson Smith [mailto:eric(at)did-it(dot)com]
Sent: Thursday, April 10, 2003 01:45
To: Postgresql General
Subject: Re: [GENERAL] pg_dump / pg_dumpall / memory issues

We're running the 7.3 series. We are getting better backup performance
than 7.2 indeed. Looking at pg_dump.c -- it seems to use the COPY
command so perhaps throttling in the code may not be the best solution.
I did see the notes about this that Tom mentioned.

> So I'm wondering if the simple solution might be to either use a slower
> box / network connection / throttled port on the backup box, or just
> backup into another database since the copies into the other machine
> probably slow things down enough to render less of a load on the server
> being backed up.

Hmmm... that might be an interesting solution. We do have a slower
standby DB, that would be excellent for that purpose. It would be an
added incentive too, because the standby DB would be hot after backup.
I'm gonna give this a shot and report back. I guess we can do a
pg_dumpall from the standby DB as soon as the main DB has finished
backing up too!

Regards
- Ericson Smith
eric(at)did-it(dot)com

scott.marlowe wrote:

>What version of pgsql are you running? I've gotten MUCH better backup
>restore performance on 7.3 series than I did with 7.2. I can backup 1 gig
>of data in about 10 minutes across 100 Base Tx network with a pipe like
>so:
>
>pg_dump -h hostname databasename | psql databasename
>
>It took something like 30 minutes to an hour before to do this in 7.2.x.
>
>(My box is a dual PIII 750 with 1.5 gig ram, and a 10KRPM UWScsi drive for
>the database seperate from the system.)
>
>
>
>
>

---------------------------(end of broadcast)---------------------------
TIP 6: Have you searched our list archives?

http://archives.postgresql.org

Browse pgsql-general by date

  From Date Subject
Next Message Amir Becher 2003-04-10 16:22:05 Corrupt index
Previous Message Radu-Adrian Popescu 2003-04-10 14:42:22 Re: Programms working on a PostgreSQL database written in C++?