Re: pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR

From: Andres Freund <andres(at)anarazel(dot)de>
To: Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>, pgsql-hackers(at)postgresql(dot)org, pgsql-release(at)postgresql(dot)org
Cc: Noah Misch <noah(at)leadboat(dot)com>, pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: Re: pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR
Date: 2022-02-09 00:43:47
Message-ID: 20220209004347.mnwaoiv5x7dntuvi@alap3.anarazel.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers pgsql-hackers

Hi,

On 2022-02-08 22:13:01 +0100, Tomas Vondra wrote:
> On 10/24/21 03:40, Noah Misch wrote:
> > Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURRENTLY.
> >
> > CIC and REINDEX CONCURRENTLY assume backends see their catalog changes
> > no later than each backend's next transaction start. That failed to
> > hold when a backend absorbed a relevant invalidation in the middle of
> > running RelationBuildDesc() on the CIC index. Queries that use the
> > resulting index can silently fail to find rows. Fix this for future
> > index builds by making RelationBuildDesc() loop until it finishes
> > without accepting a relevant invalidation. It may be necessary to
> > reindex to recover from past occurrences; REINDEX CONCURRENTLY suffices.
> > Back-patch to 9.6 (all supported versions).
> >
> > Noah Misch and Andrey Borodin, reviewed (in earlier versions) by Andres
> > Freund.
> >
> > Discussion: https://postgr.es/m/20210730022548.GA1940096@gust.leadboat.com
> >
>
> Unfortunately, this seems to have broken CLOBBER_CACHE_ALWAYS builds. Since
> this commit, initdb never completes due to infinite retrying over and over
> (on the first RelationBuildDesc call).

Ugh. Do we need to do something about WRT the next set of minor releases? Is
there a a chance of this occuring in "real" workloads?

Greetings,

Andres Freund

In response to

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message Michael Paquier 2022-02-09 01:15:56 pgsql: Add TAP test to automate the equivalent of check_guc
Previous Message Tom Lane 2022-02-09 00:27:05 pgsql: Remove ppport.h's broken re-implementation of eval_pv().

Browse pgsql-hackers by date

  From Date Subject
Next Message Jacob Champion 2022-02-09 00:52:48 Re: [PATCH] Accept IP addresses in server certificate SANs
Previous Message Joe Conway 2022-02-09 00:38:22 Re: [PATCH v2] use has_privs_for_role for predefined roles