Re: Recovery will take 10 hours

From: Brendan Duddridge <brendan(at)clickspace(dot)com>
To: Jeff Frost <jeff(at)frostconsultingllc(dot)com>
Cc: PostgreSQL Performance <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Recovery will take 10 hours
Date: 2006-04-20 23:11:01
Message-ID: BCAE93E6-B799-4B6F-9F78-AA694342A169@clickspace.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Hi Jeff,

The WAL files are stored on a separate server and accessed through an
NFS mount located at /wal_archive.

However, the restore failed about 5 hours in after we got this error:

[2006-04-20 16:41:28 MDT] LOG: restored log file
"000000010000018F00000034" from archive
[2006-04-20 16:41:35 MDT] LOG: restored log file
"000000010000018F00000035" from archive
[2006-04-20 16:41:38 MDT] LOG: restored log file
"000000010000018F00000036" from archive
sh: line 1: /wal_archive/000000010000018F00000037.gz: No such file or
directory
[2006-04-20 16:41:46 MDT] LOG: could not open file "pg_xlog/
000000010000018F00000037" (log file 399, segment 55): No such file or
directory
[2006-04-20 16:41:46 MDT] LOG: redo done at 18F/36FFF254
sh: line 1: /wal_archive/000000010000018F00000036.gz: No such file or
directory
[2006-04-20 16:41:46 MDT] PANIC: could not open file "pg_xlog/
000000010000018F00000036" (log file 399, segment 54): No such file or
directory
[2006-04-20 16:41:46 MDT] LOG: startup process (PID 9190) was
terminated by signal 6
[2006-04-20 16:41:46 MDT] LOG: aborting startup due to startup
process failure
[2006-04-20 16:41:46 MDT] LOG: logger shutting down

The /wal_archive/000000010000018F00000037.gz is there accessible on
the NFS mount.

Is there a way to continue the restore process from where it left off?

Thanks,

____________________________________________________________________
Brendan Duddridge | CTO | 403-277-5591 x24 | brendan(at)clickspace(dot)com

ClickSpace Interactive Inc.
Suite L100, 239 - 10th Ave. SE
Calgary, AB T2G 0V9

http://www.clickspace.com

On Apr 20, 2006, at 3:19 PM, Jeff Frost wrote:

> On Thu, 20 Apr 2006, Brendan Duddridge wrote:
>
>> Hi,
>>
>> We had a database issue today that caused us to have to restore to
>> our most recent backup. We are using PITR so we have 3120 WAL
>> files that need to be applied to the database.
>>
>> After 45 minutes, it has restored only 230 WAL files. At this
>> rate, it's going to take about 10 hours to restore our database.
>>
>> Most of the time, the server is not using very much CPU time or I/
>> O time. So I'm wondering what can be done to speed up the process?
>
> Brendan,
>
> Where are the WAL files being stored and how are they being read back?
>
> --
> Jeff Frost, Owner <jeff(at)frostconsultingllc(dot)com>
> Frost Consulting, LLC http://www.frostconsultingllc.com/
> Phone: 650-780-7908 FAX: 650-649-1954
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 1: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo(at)postgresql(dot)org so that
> your
> message can get through to the mailing list cleanly
>

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Brendan Duddridge 2006-04-20 23:15:00 Re: Recovery will take 10 hours
Previous Message Luke Lonergan 2006-04-20 21:27:59 Re: Quick Performance Poll