Re: Logical Replication WIP

From: Petr Jelinek <petr(dot)jelinek(at)2ndquadrant(dot)com>
To: Erik Rijkers <er(at)xs4all(dot)nl>
Cc: Andres Freund <andres(at)anarazel(dot)de>, Peter Eisentraut <peter(dot)eisentraut(at)2ndquadrant(dot)com>, Steve Singer <steve(at)ssinger(dot)info>, Craig Ringer <craig(at)2ndquadrant(dot)com>, Simon Riggs <simon(at)2ndquadrant(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, pgsql-hackers-owner(at)postgresql(dot)org
Subject: Re: Logical Replication WIP
Date: 2016-12-20 08:43:14
Message-ID: a98b5b1c-99e8-3b95-cabe-7c9f343922a6@2ndquadrant.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 20/12/16 08:10, Erik Rijkers wrote:
> On 2016-12-19 08:04, Erik Rijkers wrote:
>> On 2016-12-18 11:12, Petr Jelinek wrote:
>>
>> (now using latest: patchset:)
>>
>> 0001-Add-PUBLICATION-catalogs-and-DDL-v14.patch
>> 0002-Add-SUBSCRIPTION-catalog-and-DDL-v14.patch
>> 0003-Define-logical-replication-protocol-and-output-plugi-v14.patch
>> 0004-Add-logical-replication-workers-v14.patch
>> 0005-Add-separate-synchronous-commit-control-for-logical--v14.patch
>>
>> Sometimes replication (caused by a pgbench run) runs for a few
>> seconds replicating all 4 pgbench tables correctly, but never longer
>> than 10 to 20 seconds.
>>
>
> I've concocted pgbench_derail.sh. It assumes 2 instances running,
> initially without the publication and subsciption.
>
> There are two separate installations, on the same machine.
>

Thanks, this was very useful. We had wrong attribute index arithmetics
in the place where we verify that replica identities match well enough.

BTW that script you have for testing has 2 minor flaws in terms of
pgbench_history - the order by is not unique enough (adding mtime or
something helps) and second, the pgbench actually truncates the
pgbench_history unless -n is added to command line.

So attached is v15, which fixes this and the
ERROR: unexpected command tag "PUBLICATION
as reported by Steve Singer (plus tab completion fixes and doc fixes).

--
Petr Jelinek http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services

Attachment Content-Type Size
0001-Add-PUBLICATION-catalogs-and-DDL-v15.patch.gz application/gzip 32.8 KB
0002-Add-SUBSCRIPTION-catalog-and-DDL-v15.patch.gz application/gzip 29.6 KB
0003-Define-logical-replication-protocol-and-output-plugi-v15.patch.gz application/gzip 12.8 KB
0004-Add-logical-replication-workers-v15.patch.gz application/gzip 42.8 KB
0005-Add-separate-synchronous-commit-control-for-logical--v15.patch.gz application/gzip 1.7 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Fabien COELHO 2016-12-20 08:43:23 Re: BUG: pg_stat_statements query normalization issues with combined queries
Previous Message Fabien COELHO 2016-12-20 08:40:29 BUG: pg_stat_statements query normalization issues with combined queries