Re: Recovery will take 10 hours

From: Simon Riggs <simon(at)2ndquadrant(dot)com>
To: Brendan Duddridge <brendan(at)clickspace(dot)com>
Cc: PostgreSQL Performance <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Recovery will take 10 hours
Date: 2006-04-23 16:06:07
Message-ID: 1145808368.3112.222.camel@localhost.localdomain
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Thu, 2006-04-20 at 13:29 -0600, Brendan Duddridge wrote:

> We had a database issue today that caused us to have to restore to
> our most recent backup. We are using PITR so we have 3120 WAL files
> that need to be applied to the database.

How often are you taking base backups?

> After 45 minutes, it has restored only 230 WAL files. At this rate,
> it's going to take about 10 hours to restore our database.

> Most of the time, the server is not using very much CPU time or I/O
> time. So I'm wondering what can be done to speed up the process?

You can improve the performance of a recovery by making your restore
command overlap retrieval of files. The recovery process waits while the
restore command returns a file, so by doing an asynchronous lookahead of
one file you can be gunzipping the next file while the current one is
being processed.

I'll either document this better, or build an overlap into the restore
command processing itself, so the script doesn't need to do this.

--
Simon Riggs
EnterpriseDB http://www.enterprisedb.com/

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Bruno Almeida do Lago 2006-04-23 20:57:40 GROUP BY Vs. Sub SELECT
Previous Message clemens.bertschler 2006-04-22 21:34:13 Easy question