Skip site navigation (1) Skip section navigation (2)

Re: PITR Backups

From: Dan Gorman <dgorman(at)hi5(dot)com>
To: Toru SHIMOGAKI <shimogaki(dot)toru(at)oss(dot)ntt(dot)co(dot)jp>
Cc: Steve Atkins <steve(at)blighty(dot)com>, PostgreSQL Performance <pgsql-performance(at)postgresql(dot)org>
Subject: Re: PITR Backups
Date: 2007-06-22 07:43:13
Message-ID: 4FB37509-BC18-4B73-A56A-BDC35D582F6E@hi5.com (view raw or flat)
Thread:
Lists: pgsql-performance
Here is an example. Most of the snap shots worked fine, but I did get  
this once:

Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [9-1] 2007-06-21  
00:39:43 PDTLOG:  redo done at 71/99870670
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [10-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28905 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [11-1] 2007-06-21  
00:39:43 PDTWARNING:  page 13626 of relation 1663/16384/76716 did not  
exist
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [12-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28904 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [13-1] 2007-06-21  
00:39:43 PDTWARNING:  page 26711 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [14-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28900 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [15-1] 2007-06-21  
00:39:43 PDTWARNING:  page 3535208 of relation 1663/16384/33190 did  
not exist
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [16-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28917 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [17-1] 2007-06-21  
00:39:43 PDTWARNING:  page 3535207 of relation 1663/16384/33190 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [18-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28916 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [19-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28911 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [20-1] 2007-06-21  
00:39:43 PDTWARNING:  page 26708 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [21-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28914 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [22-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28909 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [23-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28908 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [24-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28913 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [25-1] 2007-06-21  
00:39:43 PDTWARNING:  page 26712 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [26-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28918 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [27-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28912 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [28-1] 2007-06-21  
00:39:43 PDTWARNING:  page 3535209 of relation 1663/16384/33190 did  
not exist
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [29-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28907 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [30-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28906 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [31-1] 2007-06-21  
00:39:43 PDTWARNING:  page 26713 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [32-1] 2007-06-21  
00:39:43 PDTWARNING:  page 17306 of relation 1663/16384/76710 did not  
exist
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [33-1] 2007-06-21  
00:39:43 PDTWARNING:  page 26706 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [34-1] 2007-06-21  
00:39:43 PDTWARNING:  page 800226 of relation 1663/16384/33204 did  
not exist
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [35-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28915 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [36-1] 2007-06-21  
00:39:43 PDTWARNING:  page 26710 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [37-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28903 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [38-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28902 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [39-1] 2007-06-21  
00:39:43 PDTWARNING:  page 28910 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:39:43 sfmedstorageha001 postgres[3506]: [40-1] 2007-06-21  
00:39:43 PDTPANIC:  WAL contains references to invalid pages
Jun 21 00:39:43 sfmedstorageha001 postgres[3503]: [1-1] 2007-06-21  
00:39:43 PDTLOG:  startup process (PID 3506) was terminated by signal 6
Jun 21 00:39:43 sfmedstorageha001 postgres[3503]: [2-1] 2007-06-21  
00:39:43 PDTLOG:  aborting startup due to startup process failure
Jun 21 00:39:43 sfmedstorageha001 postgres[3505]: [1-1] 2007-06-21  
00:39:43 PDTLOG:  logger shutting down
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [1-1] 2007-06-21  
00:40:39 PDTLOG:  database system was interrupted while in recovery  
at 2007-06-21 00:36:40 PDT
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [1-2] 2007-06-21  
00:40:39 PDTHINT:  This probably means that some data is corrupted  
and you will have to use the last backup for
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [1-3]  recovery.
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [2-1] 2007-06-21  
00:40:39 PDTLOG:  checkpoint record is at 71/9881E928
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [3-1] 2007-06-21  
00:40:39 PDTLOG:  redo record is at 71/986BF148; undo record is at  
0/0; shutdown FALSE
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [4-1] 2007-06-21  
00:40:39 PDTLOG:  next transaction ID: 0/2871389429; next OID: 83795
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [5-1] 2007-06-21  
00:40:39 PDTLOG:  next MultiXactId: 1; next MultiXactOffset: 0
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [6-1] 2007-06-21  
00:40:39 PDTLOG:  database system was not properly shut down;  
automatic recovery in progress
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [7-1] 2007-06-21  
00:40:39 PDTLOG:  redo starts at 71/986BF148
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [8-1] 2007-06-21  
00:40:39 PDTLOG:  record with zero length at 71/998706A8
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [9-1] 2007-06-21  
00:40:39 PDTLOG:  redo done at 71/99870670
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [10-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28905 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [11-1] 2007-06-21  
00:40:39 PDTWARNING:  page 13626 of relation 1663/16384/76716 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [12-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28904 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [13-1] 2007-06-21  
00:40:39 PDTWARNING:  page 26711 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [14-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28900 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [15-1] 2007-06-21  
00:40:39 PDTWARNING:  page 3535208 of relation 1663/16384/33190 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [16-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28917 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [17-1] 2007-06-21  
00:40:39 PDTWARNING:  page 3535207 of relation 1663/16384/33190 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [18-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28916 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [19-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28911 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [20-1] 2007-06-21  
00:40:39 PDTWARNING:  page 26708 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [21-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28914 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [22-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28909 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [23-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28908 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [24-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28913 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [25-1] 2007-06-21  
00:40:39 PDTWARNING:  page 26712 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [26-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28918 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [27-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28912 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [28-1] 2007-06-21  
00:40:39 PDTWARNING:  page 3535209 of relation 1663/16384/33190 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [29-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28907 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [30-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28906 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [31-1] 2007-06-21  
00:40:39 PDTWARNING:  page 26713 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [32-1] 2007-06-21  
00:40:39 PDTWARNING:  page 17306 of relation 1663/16384/76710 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [33-1] 2007-06-21  
00:40:39 PDTWARNING:  page 26706 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [34-1] 2007-06-21  
00:40:39 PDTWARNING:  page 800226 of relation 1663/16384/33204 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [35-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28915 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [36-1] 2007-06-21  
00:40:39 PDTWARNING:  page 26710 of relation 1663/16384/76719 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [37-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28903 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [38-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28902 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [39-1] 2007-06-21  
00:40:39 PDTWARNING:  page 28910 of relation 1663/16384/76718 was  
uninitialized
Jun 21 00:40:39 sfmedstorageha001 postgres[3757]: [40-1] 2007-06-21  
00:40:39 PDTPANIC:  WAL contains references to invalid pages
Jun 21 00:40:39 sfmedstorageha001 postgres[3755]: [1-1] 2007-06-21  
00:40:39 PDTLOG:  startup process (PID 3757) was terminated by signal 6
Jun 21 00:40:39 sfmedstorageha001 postgres[3755]: [2-1] 2007-06-21  
00:40:39 PDTLOG:  aborting startup due to startup process failure
Jun 21 00:40:39 sfmedstorageha001 postgres[3756]: [1-1] 2007-06-21  
00:40:39 PDTLOG:  logger shutting down


On Jun 22, 2007, at 12:30 AM, Toru SHIMOGAKI wrote:

>
> Steve Atkins wrote:
>
>>> - When we take a PITR base backup with hardware level snapshot  
>>> operation
>>>   (not filesystem level) which a lot of storage vender provide,  
>>> the backup data
>>>   can be corrupted as Dan said. During recovery we can't even  
>>> read it,
>>>   especially if meta-data was corrupted.
>> I can't see any explanation for how this could happen, other
>> than your hardware vendor is lying about snapshot ability.
>
> All of the hardware vendors I asked always said:
>
>  "The hardware level snapshot has nothing to do with filesystem  
> condition and of course with what data has been written from  
> operating system chache to the hard disk platter. It just copies  
> byte data on storage to the other volume.
>
> So, if any data is written during taking snapshot, we can't  
> assurance data correctness *strictly* .
>
> In Oracle, no table data is written between BEGIN BACKUP and END  
> BACKUP, and it is not a problem REDO is written..."
>
> I'd like to know the correct information if the explanation has any  
> mistakes, or a good way to avoid the probrem.
>
> I think there are users who want to migrate Oracle to PostgreSQL  
> but can't because of the problem as above.
>
>
> Best regards,
>
> -- 
> Toru SHIMOGAKI<shimogaki(dot)toru(at)oss(dot)ntt(dot)co(dot)jp>
> NTT Open Source Software Center
>
>
> ---------------------------(end of  
> broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster



In response to

Responses

pgsql-performance by date

Next:From: DimitriDate: 2007-06-22 08:06:47
Subject: Re: Data transfer very slow when connected via DSL
Previous:From: Toru SHIMOGAKIDate: 2007-06-22 07:41:24
Subject: Re: PITR Backups

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group