Re: Are file system level differential/incremental backups possible?

From: Bob Hatfield <bobhatfield(at)gmail(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: Are file system level differential/incremental backups possible?
Date: 2011-10-19 18:00:41
Message-ID: CAKikJcKKXNvbowWb57auc-BnaSQGOKs2e6RDCHOdJtYw6mVnig@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

>> Is it possible to do a full file system level backup of the data
>> directory, say once a week, and differentials or incrementals daily?
>
> I'd love to be able to do this, but you can't do it usefully at a
> file-system level. There's too much churn in the data files for even a
> binary diff to be much use - and even if it were, the performance of it
> would be miserable.

Actually, for us, a full backup is currently about 950GB which takes
about 24 hours and a diff several days later is only 150GB and takes
two hours. (It takes significantly less time not only becuase it's
less data but also because the diff job doesn't have to compete with
other backup jobs (since it's faster due to less data).)

I currently stop pg, robocopy (rsync) the changes to our DRS server,
restart pg -- then backup the data on the DRS server later. This
allows us to have our database back up within 30 minutes.

I've tested the database after doing a restore: full + diff and it
seems fine (both viewing with the application as well as running a
reindex on the entire db). I think we'll stick with this process with
the understanding that if a disaster struck, and we needed to do a
full + diff restore, that we may have a few files that are there that
that aren't needed.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Bobby Dewitt 2011-10-19 21:10:13 Logging ALL output from psql
Previous Message Martín Marqués 2011-10-19 17:30:21 inserting bytea using PHPs pg_escape_bytea()