Re: Decreasing WAL size effects

From: "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
To: Greg Smith <gsmith(at)gregsmith(dot)com>
Cc: Jason Long <mailing(dot)list(at)supernovasoftware(dot)com>, pgsql <pgsql-general(at)postgresql(dot)org>
Subject: Re: Decreasing WAL size effects
Date: 2008-10-30 17:13:16
Message-ID: 1225386796.32621.23.camel@jd-laptop.pragmaticzealot.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

On Wed, 2008-10-29 at 09:05 -0400, Greg Smith wrote:
> On Tue, 28 Oct 2008, Jason Long wrote:
>
> > I also have to ship them off site using a T1 so setting the time to
> > automatically switch files will just waste bandwidth if they are still going
> > to be 16 MB anyway.
>
> The best way to handle this is to clear the unused portion of the WAL file
> and then compress it before sending over the link. There is a utility
> named pg_clearxlogtail available at
> http://www.2ndquadrant.com/replication.htm that handles the first part of
> that you may find useful here.
>
> This reminds me yet again that pg_clearxlogtail should probably get added
> to the next commitfest for inclusion into 8.4; it's really essential for a
> WAN-based PITR setup and it would be nice to include it with the
> distribution.

What is to be gained over just using rsync with -z?

Joshua D. Drake

>
> --
> * Greg Smith gsmith(at)gregsmith(dot)com http://www.gregsmith.com Baltimore, MD
>
--

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Glyn Astill 2008-10-30 17:27:58 bytea field, a c function and pgcrypto driving me mad
Previous Message Joshua D. Drake 2008-10-30 15:54:23 Re: Are there plans to add data compression feature to postgresql?

Browse pgsql-hackers by date

  From Date Subject
Next Message Jonah H. Harris 2008-10-30 17:13:17 Re: Block-level CRC checks
Previous Message Robert Haas 2008-10-30 17:11:42 Re: WIP patch: convert SQL-language functions to return tuplestores