pgsql: Create an infrastructure for parallel computation in PostgreSQL.

From: Robert Haas <rhaas(at)postgresql(dot)org>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Create an infrastructure for parallel computation in PostgreSQL.
Date: 2015-04-30 19:22:25
Message-ID: E1Ynu2T-0005iK-Gf@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Create an infrastructure for parallel computation in PostgreSQL.

This does four basic things. First, it provides convenience routines
to coordinate the startup and shutdown of parallel workers. Second,
it synchronizes various pieces of state (e.g. GUCs, combo CID
mappings, transaction snapshot) from the parallel group leader to the
worker processes. Third, it prohibits various operations that would
result in unsafe changes to that state while parallelism is active.
Finally, it propagates events that would result in an ErrorResponse,
NoticeResponse, or NotifyResponse message being sent to the client
from the parallel workers back to the master, from which they can then
be sent on to the client.

Robert Haas, Amit Kapila, Noah Misch, Rushabh Lathia, Jeevan Chalke.
Suggestions and review from Andres Freund, Heikki Linnakangas, Noah
Misch, Simon Riggs, Euler Taveira, and Jim Nasby.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/924bcf4f16d54c55310b28f77686608684734f42

Modified Files
--------------
contrib/postgres_fdw/connection.c | 3 +
src/backend/access/heap/heapam.c | 55 ++
src/backend/access/transam/Makefile | 2 +-
src/backend/access/transam/README.parallel | 223 ++++++
src/backend/access/transam/parallel.c | 1007 ++++++++++++++++++++++++++++
src/backend/access/transam/varsup.c | 7 +
src/backend/access/transam/xact.c | 486 +++++++++++++-
src/backend/access/transam/xlog.c | 8 +
src/backend/catalog/namespace.c | 11 +-
src/backend/commands/copy.c | 3 +-
src/backend/commands/sequence.c | 14 +
src/backend/executor/execMain.c | 30 +-
src/backend/executor/functions.c | 3 +
src/backend/executor/spi.c | 32 +-
src/backend/libpq/pqmq.c | 33 +-
src/backend/postmaster/bgworker.c | 50 ++
src/backend/storage/ipc/procarray.c | 44 ++
src/backend/storage/ipc/procsignal.c | 4 +
src/backend/storage/lmgr/predicate.c | 8 +
src/backend/tcop/postgres.c | 4 +-
src/backend/tcop/utility.c | 30 +-
src/backend/utils/adt/lockfuncs.c | 30 +
src/backend/utils/fmgr/dfmgr.c | 54 ++
src/backend/utils/misc/guc.c | 23 +
src/backend/utils/time/combocid.c | 74 ++
src/backend/utils/time/snapmgr.c | 210 +++++-
src/include/access/parallel.h | 68 ++
src/include/access/xact.h | 11 +
src/include/catalog/namespace.h | 2 +-
src/include/fmgr.h | 3 +
src/include/libpq/pqmq.h | 1 +
src/include/miscadmin.h | 1 +
src/include/postmaster/bgworker.h | 2 +
src/include/storage/procarray.h | 1 +
src/include/storage/procsignal.h | 1 +
src/include/utils/combocid.h | 3 +
src/include/utils/snapmgr.h | 5 +
37 files changed, 2499 insertions(+), 47 deletions(-)

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message Alvaro Herrera 2015-04-30 20:03:24 pgsql: Fix up some loose ends for CURRENT_USER as RoleSpec
Previous Message Alvaro Herrera 2015-04-30 17:01:06 pgsql: Fix pg_upgrade's multixact handling (again)