Re: Stats collector performance improvement

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
Cc: Jan Wieck <JanWieck(at)Yahoo(dot)com>, pgsql-hackers(at)postgreSQL(dot)org
Subject: Re: Stats collector performance improvement
Date: 2006-01-02 20:20:24
Message-ID: 11924.1136233224@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-patches pgsql-performance

[ moving to -hackers ]

Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us> writes:
> I did some research on this because the numbers Tom quotes indicate there
> is something wrong in the way we process stats_command_string
> statistics.
> [ ... proposed patch that seems pretty klugy to me ... ]

I wonder whether we shouldn't consider something more drastic, like
getting rid of the intermediate stats buffer process entirely.

The original design for the stats communication code was based on the
premise that it's better to drop data than to make backends wait on
the stats collector. However, as things have turned out I think this
notion is a flop: the people who are using stats at all want the stats
to be reliable. We've certainly seen plenty of gripes from people who
are unhappy that backend-exit messages got dropped, and anyone who's
using autovacuum would really like the tuple update counts to be pretty
solid too.

If we abandoned the unreliable-communication approach, could we build
something with less overhead?

regards, tom lane

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Qingqing Zhou 2006-01-02 21:03:20 Re: Stats collector performance improvement
Previous Message Tom Lane 2006-01-02 20:00:04 Re: What bison versions are installed on buildfarm machines?

Browse pgsql-patches by date

  From Date Subject
Next Message Qingqing Zhou 2006-01-02 21:03:20 Re: Stats collector performance improvement
Previous Message Bruce Momjian 2006-01-02 19:13:47 Re: Stats collector performance improvement

Browse pgsql-performance by date

  From Date Subject
Next Message Qingqing Zhou 2006-01-02 21:03:20 Re: Stats collector performance improvement
Previous Message Bruce Momjian 2006-01-02 19:13:47 Re: Stats collector performance improvement