Re: CDC feature request

From: Ronan Dunklau <ronan(at)dunklau(dot)fr>
To: Magnus Hagander <magnus(at)hagander(dot)net>
Cc: Stepan Yankevych <Stepan_Yankevych(at)epam(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: CDC feature request
Date: 2021-03-18 13:34:46
Message-ID: 2144e2517118ebe5c0bb60261a69cc72@dunklau.fr
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

>>
>> That change table should have at lease few additional columns
>>
>> * Operation (I/D/U)
>> * txid
>> * Commit_time_stamp
>
> If you look at logical decoding, that's basically what you have, isn't
> it? It won't go into a table, but you can consume it into one if you
> want. Look at for example wal2json for examples of how to consume it
> -- but the system is pluggable so you can build your own or use one of
> the others available plugins.

Hello,

At my work, we basically did that, using wal2json, here:
https://github.com/peopledoc/connemara/blob/master/connemara_replication/src/connemara_replication.c

The code is quite simple, you could probably inspire yourself from that,
or even use it directly if your needs are basic and match was is
offered. The replication code was written to be as fast and simple as
possible.

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Álvaro Hernández 2021-03-18 13:37:01 Re: CDC feature request
Previous Message Fujii Masao 2021-03-18 13:12:48 Re: fdatasync performance problem with large number of DB files