Re: stats collector process high CPU utilization

From: Benjamin Minshall <minshall(at)intellicon(dot)biz>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Alvaro Herrera <alvherre(at)commandprompt(dot)com>, pgsql-performance(at)postgresql(dot)org
Subject: Re: stats collector process high CPU utilization
Date: 2007-02-09 16:27:07
Message-ID: 45CCA0DB.2010903@intellicon.biz
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Tom Lane wrote:
> I wrote:
>> Alvaro Herrera <alvherre(at)commandprompt(dot)com> writes:
>>> Regarding temp tables, I'd think that the pgstat entries should be
>>> getting dropped at some point in both releases. Maybe there's a bug
>>> preventing that in 8.2?
>
>> Hmmm ... I did rewrite the backend-side code for that just recently for
>> performance reasons ... could I have broken it?
>
> I did some testing with HEAD and verified that pgstat_vacuum_tabstat()
> still seems to do what it's supposed to, so that theory falls down.
>
> Alvaro, could you send Benjamin your stat-file-dumper tool so we can
> get some more info?

> Alternatively, if Benjamin wants to send me a copy
> of his stats file (off-list), I'd be happy to take a look.
>
> regards, tom lane

When I checked on the server this morning, the huge stats file has
returned to a normal size. I set up a script to track CPU usage and
stats file size, and it appears to have decreased from 90MB down to
about 2MB over roughly 6 hours last night. The CPU usage of the stats
collector also decreased accordingly.

The application logs indicate that there was no variation in the
workload over this time period, however the file size started to
decrease soon after the nightly pg_dump backups completed. Coincidence
perhaps?

Nonetheless, I would appreciate a copy of Alvaro's stat file tool just
to see if anything stands out in the collected stats.

Thanks for your help, Tom.

--
Benjamin Minshall <minshall(at)intellicon(dot)biz>
Senior Developer -- Intellicon, Inc.
http://www.intellicon.biz

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2007-02-09 16:33:06 Re: stats collector process high CPU utilization
Previous Message Tom Lane 2007-02-09 15:55:57 Re: stats collector process high CPU utilization