pgsql: Fix concurrent indexing operations with temporary tables

From: Michael Paquier <michael(at)paquier(dot)xyz>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Fix concurrent indexing operations with temporary tables
Date: 2020-01-22 00:50:50
Message-ID: E1iu4EM-0007Cn-KM@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Fix concurrent indexing operations with temporary tables

Attempting to use CREATE INDEX, DROP INDEX or REINDEX with CONCURRENTLY
on a temporary relation with ON COMMIT actions triggered unexpected
errors because those operations use multiple transactions internally to
complete their work. Here is for example one confusing error when using
ON COMMIT DELETE ROWS:
ERROR: index "foo" already contains data

Issues related to temporary relations and concurrent indexing are fixed
in this commit by enforcing the non-concurrent path to be taken for
temporary relations even if using CONCURRENTLY, transparently to the
user. Using a non-concurrent path does not matter in practice as locks
cannot be taken on a temporary relation by a session different than the
one owning the relation, and the non-concurrent operation is more
effective.

The problem exists with REINDEX since v12 with the introduction of
CONCURRENTLY, and with CREATE/DROP INDEX since CONCURRENTLY exists for
those commands. In all supported versions, this caused only confusing
error messages to be generated. Note that with REINDEX, it was also
possible to issue a REINDEX CONCURRENTLY for a temporary relation owned
by a different session, leading to a server crash.

The idea to enforce transparently the non-concurrent code path for
temporary relations comes originally from Andres Freund.

Reported-by: Manuel Rigger
Author: Michael Paquier, Heikki Linnakangas
Reviewed-by: Andres Freund, Álvaro Herrera, Heikki Linnakangas
Discussion: https://postgr.es/m/CA+u7OA6gP7YAeCguyseusYcc=uR8+ypjCcgDDCTzjQ+k6S9ksQ@mail.gmail.com
Backpatch-through: 9.4

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/a904abe2e284f570168839e52e18ef0b7f26179d

Modified Files
--------------
doc/src/sgml/ref/create_index.sgml | 5 ++
doc/src/sgml/ref/drop_index.sgml | 5 ++
doc/src/sgml/ref/reindex.sgml | 5 ++
src/backend/catalog/index.c | 9 ++++
src/backend/commands/indexcmds.c | 65 +++++++++++++++++++++-----
src/backend/commands/tablecmds.c | 18 +++++++-
src/test/regress/expected/create_index.out | 74 ++++++++++++++++++++++++++++++
src/test/regress/sql/create_index.sql | 67 +++++++++++++++++++++++++++
8 files changed, 235 insertions(+), 13 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Amit Kapila 2020-01-22 02:15:50 pgsql: Fix the computation of max dead tuples during the vacuum.
Previous Message Tom Lane 2020-01-21 21:17:29 pgsql: Clarify behavior of adding and altering a column in same ALTER c