Re: Full statement logging problematic on larger machines?

From: Frank Joerdens <frank(at)joerdens(dot)de>
To: Andrew Dunstan <andrew(at)dunslane(dot)net>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Guillaume Smet <guillaume(dot)smet(at)gmail(dot)com>, pgsql-performance(at)postgresql(dot)org, Nic Ferrier <nic(at)woome(dot)com>, Avleen Vig <avleen(at)woome(dot)com>, Mike Rogers <mike(dot)rogers(at)woome(dot)com>
Subject: Re: Full statement logging problematic on larger machines?
Date: 2009-03-20 22:15:01
Message-ID: 7d10d2df0903201515l7e443adfjabb9d8399fc19059@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Fri, Mar 20, 2009 at 8:21 PM, Andrew Dunstan <andrew(at)dunslane(dot)net> wrote:
>
>
> Frank Joerdens wrote:
>>
>> On Thu, Mar 12, 2009 at 1:38 PM, Frank Joerdens <frank(at)joerdens(dot)de> wrote:
>>
>>>
>>> On Thu, Mar 12, 2009 at 1:45 AM, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:
>>> [...]
>>>
>>>>
>>>> You could try changing _IOLBF
>>>> to _IOFBF near the head of postmaster/syslogger.c and see if that helps.
[...]
>> Can you explain again what the extent of multiplexed messages I'll
>> have to expect is? What exactly is the substance of the tradeoff?
>> Occasionally the server will write the same line twice? Don't really
>> follow why ...
[...]
> I don't believe changing this will result in any multiplexing. The
> multiplexing problem was solved in 8.3 by the introduction of the chunking
> protocol between backends and the syslogger, and changing the output
> buffering of the syslogger should not cause a multiplexing problem, since
> it's a single process.

Hum, we're still on 8.2 - last attempt to upgrade before xmas was
unsuccessful; we had to roll back due to not fully understood
performance issues. We think we nailed the root cause(s) those though
and will make another better planned effort to upgrade before March is
out.

Oh well, maybe this all means we shouldn't try to get this running on
8.2 and just tackle the issue again after the upgrade ...

Cheers,

Frank

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Jignesh K. Shah 2009-03-20 23:39:13 Re: Proposal of tunable fix for scalability of 8.4
Previous Message Alvaro Herrera 2009-03-20 22:05:13 Re: Proposal of tunable fix for scalability of 8.4