Skip site navigation (1) Skip section navigation (2)

Re: GDQ iimplementation

From: Josh Berkus <josh(at)agliodbs(dot)com>
To: pgsql-cluster-hackers(at)postgresql(dot)org
Subject: Re: GDQ iimplementation
Date: 2010-05-17 21:46:13
Message-ID: 4BF1B925.7010809@agliodbs.com (view raw or flat)
Thread:
Lists: pgsql-cluster-hackers
Jan, Marko, Simon,

I'm concerned that doing anything about the write overhead issue was 
discarded almost immediately in this discussion.  This is not a trivial 
issue for performance; it means that each row which is being tracked by 
the GDQ needs to be written to disk a minimum of 4 times (once to WAL, 
once to table, once to WAL for queue, once to queue).  That's at least 
one time too many, and effectively doubles the load on the master server.

This is particularly unacceptable overhead for systems where users are 
not that interested in retaining the queue after an unexpected shutdown.

Surely there's some way around this?  Some kind of special 
fsync-on-write table, for example?  The access pattern to a queue is 
quite specialized.

-- 
                                   -- Josh Berkus
                                      PostgreSQL Experts Inc.
                                      http://www.pgexperts.com

In response to

Responses

pgsql-cluster-hackers by date

Next:From: Marko KreenDate: 2010-05-17 22:52:26
Subject: Re: GDQ iimplementation
Previous:From: Simon RiggsDate: 2010-05-17 17:01:22
Subject: Re: BOF at pgCon?

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group