Re: logical changeset generation v6.5

From: Andres Freund <andres(at)2ndquadrant(dot)com>
To: pgsql-hackers(at)postgresql(dot)org
Subject: Re: logical changeset generation v6.5
Date: 2013-11-05 15:21:41
Message-ID: 20131105152141.GA14819@awork2.anarazel.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi,

Attached to this mail and in the xlog-decoding-rebasing-remapping branch
in my git[1] repository you can find the next version of the patchset that:
* Fixes full table rewrites of catalog tables using the method Robert
prefers (which is to log rewrite mappings to disk)
* Extract the REPLICA IDENTITY as configured with ALTER TABLE for the
old tuple for UPDATEs and DELETEs
* Much better support for synchronous replication
* Better resource cleanup (as in we need less local WAL available)
* Lots of smaller fixes

The change around REPLICA IDENTITY is *incompatible* to older output
plugins since we now log tuples using the table's TupleDesc, not the
indexes.

Robert, I'd be very grateful if you could have a look at patch 0007
implementing what we've discussed. I kept it separate to make it easier
to look at it in isolation, but I think in the end it partially should
be merged into the wal_level=logical patch.
I still think the "wide cmin/cmax" solution is more elegant and has
wider applicability, but this works as well although it's about 5 times
the code.

Comments?

[1]: http://git.postgresql.org/gitweb/?p=users/andresfreund/postgres.git;a=summary
Greetings,

Andres Freund

--
Andres Freund http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services

Attachment Content-Type Size
0001-Add-command-to-set-the-REPLICA-IDENTITY-for-a-table.patch.gz application/x-patch-gzip 13.4 KB
0002-wal_decoding-Add-a-table-s-replication-identity-inde.patch.gz application/x-patch-gzip 1.6 KB
0003-wal_decoding-Add-wal_level-logical-and-log-data-requ.patch.gz application/x-patch-gzip 14.7 KB
0004-wal_decoding-Log-xl_running_xact-s-at-a-higher-frequ.patch.gz application/x-patch-gzip 3.1 KB
0005-wal_decoding-Add-option-to-use-user-defined-tables-a.patch.gz application/x-patch-gzip 1.7 KB
0006-wal_decoding-Introduce-wal-decoding-via-catalog-time.patch.gz application/x-patch-gzip 66.0 KB
0007-wal_decoding-Implement-VACUUM-FULL-CLUSTER-support-v.patch.gz application/x-patch-gzip 12.4 KB
0008-wal_decoding-Only-peg-the-xmin-horizon-for-catalog-t.patch.gz application/x-patch-gzip 5.3 KB
0009-wal_decoding-Allow-walsender-s-to-connect-to-a-speci.patch.gz application/x-patch-gzip 4.0 KB
0010-wal_decoding-logical-changeset-extraction-walsender-.patch.gz application/x-patch-gzip 10.1 KB
0011-wal_decoding-test_decoding-Add-a-simple-decoding-mod.patch.gz application/x-patch-gzip 3.5 KB
0012-wal_decoding-pg_recvlogical-Introduce-pg_receivexlog.patch.gz application/x-patch-gzip 9.1 KB
0013-Fix-pg_isolation_regress-to-work-outside-its-build-d.patch.gz application/x-patch-gzip 1.6 KB
0014-wal_decoding-test_logical_decoding-Add-extension-for.patch.gz application/x-patch-gzip 22.6 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Leonardo Francalanci 2013-11-05 15:22:15 Re: Fast insertion indexes: why no developments
Previous Message Claudio Freire 2013-11-05 14:58:08 Re: Fast insertion indexes: why no developments