pgsql: Optimize fileset usage in apply worker.

From: Amit Kapila <akapila(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Optimize fileset usage in apply worker.
Date: 2021-09-02 02:55:11
Message-ID: E1mLcsh-0000Ud-QO@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Optimize fileset usage in apply worker.

Use one fileset for the entire worker lifetime instead of using
separate filesets for each streaming transaction. Now, the
changes/subxacts files for every streaming transaction will be
created under the same fileset and the files will be deleted
after the transaction is completed.

This patch extends the BufFileOpenFileSet and BufFileDeleteFileSet
APIs to allow users to specify whether to give an error on missing
files.

Author: Dilip Kumar, based on suggestion by Thomas Munro
Reviewed-by: Hou Zhijie, Masahiko Sawada, Amit Kapila
Discussion: https://postgr.es/m/E1mCC6U-0004Ik-Fs@gemulon.postgresql.org

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/31c389d8de915b705ee06c7a6e9246e20f36b9dc

Modified Files
--------------
src/backend/replication/logical/launcher.c | 6 +-
src/backend/replication/logical/worker.c | 257 ++++++-----------------------
src/backend/storage/file/buffile.c | 22 ++-
src/backend/utils/sort/logtape.c | 2 +-
src/backend/utils/sort/sharedtuplestore.c | 3 +-
src/include/replication/worker_internal.h | 10 +-
src/include/storage/buffile.h | 5 +-
7 files changed, 86 insertions(+), 219 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Fujii Masao 2021-09-02 05:03:51 pgsql: Enhance pg_stat_reset_single_table_counters function.
Previous Message Michael Paquier 2021-09-02 02:37:00 pgsql: doc: Replace some uses of "which" by "that" in parallel.sgml