Re: PG12 autovac issues

From: Andres Freund <andres(at)anarazel(dot)de>
To: Justin King <kingpin867(at)gmail(dot)com>
Cc: pgsql-admin(at)lists(dot)postgresql(dot)org
Subject: Re: PG12 autovac issues
Date: 2020-03-18 01:19:52
Message-ID: 20200318011952.caitfhlslpq6zype@alap3.anarazel.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin pgsql-general

Hi,

On 2020-03-17 17:18:57 -0500, Justin King wrote:
> As you can see in this table, there are only ~80K rows, but billions
> of updates. What we have observed is that the frozenxid reaches the
> 200M mark fairly quickly because of the amount of activity.

And each of those updates is in a separate transaction? Is that
required? I.e. any chance to perform multiple of those updates in one
transaction?

Have you considered just increasing the vacuum limit? It's mostly there
because it can increase space usage a bit, but given today's systems its
not a usually a problem unless you have hundreds of postgres instances
on a single system. It's pretty common to just increase that to 1.8
billion or so.

From a single stats snapshot we can't actually understand the actual xid
consumption - is it actually the xid usage that triggers the vacuums?

What makes you think it is a problem that you have all these vacuums? If
you actually update that much, and you have indexes, you're going want a
lot of vacuums?

> What is interesting is that this happens with the 'postgres' and
> 'template1' databases as well and there is absolutely no activity in
> those databases.

That's normal. They should be pretty darn quick in v12?

Greetings,

Andres Freund

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Adrian Klaver 2020-03-18 15:13:14 Re: Fwd: PG12 autovac issues
Previous Message Jeff Janes 2020-03-17 23:57:32 Re: PG12 autovac issues

Browse pgsql-general by date

  From Date Subject
Next Message Ian Barwick 2020-03-18 02:08:53 Re: Automatic failover
Previous Message Jeff Janes 2020-03-17 23:57:32 Re: PG12 autovac issues