Re: turning fsync off for WAL

From: "Ram Ravichandran" <ramkaka(at)gmail(dot)com>
To: "Greg Smith" <gsmith(at)gregsmith(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: turning fsync off for WAL
Date: 2008-06-03 03:40:37
Message-ID: c8cd6fbb0806022040q3d8c418epf0d708686301ed66@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

>
>
>> Are you sure this will work correctly for database use at all? The known
> issue listed at http://www.persistentfs.com/documentation/Release_Notessounded like a much bigger consistancy concern than the fsync trivia you're
> bringing up:
>
> "In the current Technology Preview release, any changes to an open file's
> meta data are not saved to S3 until the file is closed. As a result, if
> PersistentFS or the system crashes while writing a file, it is possible for
> the file size in the file's directory entry to be greater than the actual
> number of file blocks written to S3..."
>
> This sounds like you'll face potential file corruption every time the
> database goes down for some reason, on whatever database files happen to be
> open at the time.
>
> Given the current state of EC2, I don't know why you'd take this approach
> instead of just creating an AMI to install the database into.
>
> --
> * Greg Smith gsmith(at)gregsmith(dot)com http://www.gregsmith.com Baltimore, MD
>

The problem that I am facing is that EC2 has no persistent storage (at least
currently). So, if the server restarts for some reason, all data on the
local disks are gone. The idea was to store the tables on the non-persistent
local disk, and do the WAL on to an S3 mounted drive. If the server goes
down for some reason, I was hoping to recover by replaying the WAL. I was
hoping that by faking the fsyncs, I would not incur the actual charges from
Amazon until the file system writes into S3.
Also, since WAL is on a separate FS, it will not affect my disk-write
rates.

Ram

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Hiroshi Saito 2008-06-03 03:45:55 Re: FW: make rows unique across db's without UUIP on windows?
Previous Message Sushant Sinha 2008-06-03 03:13:49 Re: [GENERAL] Fragments in tsearch2 headline