Re: [RFC] Incremental backup v3: incremental PoC

From: Marco Nenciarini <marco(dot)nenciarini(at)2ndquadrant(dot)it>
To:
Cc: PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [RFC] Incremental backup v3: incremental PoC
Date: 2015-01-07 10:00:54
Message-ID: 54AD03D6.8070907@2ndquadrant.it
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Il 06/01/15 14:26, Robert Haas ha scritto:
> I suggest leaving this out altogether for the first version. I can
> think of three possible ways that we can determine which blocks need
> to be backed up. One, just read every block in the database and look
> at the LSN of each one. Two, maintain a cache of LSN information on a
> per-segment (or smaller) basis, as you suggest here. Three, scan the
> WAL generated since the incremental backup and summarize it into a
> list of blocks that need to be backed up. This last idea could either
> be done when the backup is requested, or it could be done as the WAL
> is generated and used to populate the LSN cache. In the long run, I
> think some variant of approach #3 is likely best, but in the short
> run, approach #1 (scan everything) is certainly easiest. While it
> doesn't optimize I/O, it still gives you the benefit of reducing the
> amount of data that needs to be transferred and stored, and that's not
> nothing. If we get that much working, we can improve things more
> later.
>

Hi,
The patch now uses the approach #1, but I've just sent a patch that uses
the #2 approach.

54AD016E(dot)9020406(at)2ndquadrant(dot)it

Regards,
Marco

--
Marco Nenciarini - 2ndQuadrant Italy
PostgreSQL Training, Services and Support
marco(dot)nenciarini(at)2ndQuadrant(dot)it | www.2ndQuadrant.it

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Simon Riggs 2015-01-07 10:04:44 Re: parallel mode and parallel contexts
Previous Message Petr Jelinek 2015-01-07 09:53:59 Re: XLOG_PARAMETER_CHANGE handling of wal_log_hints