Re: xlogdump fixups and WAL log question.

From: "Simon Riggs" <simon(at)2ndquadrant(dot)com>
To: "Theo Schlossnagle" <jesus(at)omniti(dot)com>
Cc: "Martijn van Oosterhout" <kleptog(at)svana(dot)org>, <pgsql-hackers(at)postgresql(dot)org>, "Diogo Biazus" <diogob(at)gmail(dot)com>
Subject: Re: xlogdump fixups and WAL log question.
Date: 2006-10-21 19:12:07
Message-ID: 1161457927.4211.1.camel@silverbirch.site
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Sat, 2006-10-21 at 09:00 -0400, Theo Schlossnagle wrote:
> On Oct 21, 2006, at 6:08 AM, Martijn van Oosterhout wrote:
>
> > On Sat, Oct 21, 2006 at 10:37:51AM +0100, Simon Riggs wrote:
> >> Turning off WAL is a difficult topic. Without it you have no crash
> >> recovery, which IMHO everybody says they don't care about until they
> >> crash, then they realise. It's hard to be selective about writing WAL
> >> for specific operations also.
> >
> > It's been discussed before. One idea is to declare tables without
> > logging. The idea being that during recovery those tables and related
> > indexes are simply truncated. No foreign keys allowed. Obviously they
> > will not be saved via PITR either.
> >
> > Put another way, the table structure is saved in WAL, but the data
> > isn't.
>
> This is exactly what I'd like. Simon suggested turning off WAL
> during the loads as a possible hack solution. The reason this won't
> work is that we snap all the time, lots of tables. We have between
> 2000 and 4000 snapshot operations per day (throughout). At the same
> time we have reporting queries running (that create and/or populate
> other tables) that last from 5 minutes to 18 hours. It is important
> that we run everything but the snapshots with WAL on (as we must have
> PITR -- sans snapshots)

These tables are loaded once then read-only, yes?

--
Simon Riggs
EnterpriseDB http://www.enterprisedb.com

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Theo Schlossnagle 2006-10-21 19:17:49 Re: xlogdump fixups and WAL log question.
Previous Message Bruce Momjian 2006-10-21 19:09:35 Re: [COMMITTERS] pgsql: Fix up some problems in handling of