Re: Built-in Raft replication

From: Jim Nasby <jnasby(at)upgrade(dot)com>
To: Devrim Gündüz <devrim(at)gunduz(dot)org>
Cc: Greg Sabino Mullane <htamfids(at)gmail(dot)com>, Ashutosh Bapat <ashutosh(dot)bapat(dot)oss(at)gmail(dot)com>, Andrey Borodin <x4mmm(at)yandex-team(dot)ru>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Konstantin Osipov <kostja(dot)osipov(at)gmail(dot)com>, Nikolay Samokhvalov <nik(at)postgres(dot)ai>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Built-in Raft replication
Date: 2025-04-29 20:16:07
Message-ID: CAMFBP2oGM9N8Kty-3DzRmmgV0=ROB7ss7Rudw8Wida92t9O0+w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

I've always assumed there'd have to be at least one global stream, if for
no other purpose than to be the source of truth about transaction commit
ordering (though, I was thinking of supporting multiple streams for one
database). Presumably the same could be used for shared objects. Or perhaps
shared objects just get their own stream. Either way, having a master
commit record that points at LSNs of various other streams is what I'd been
thinking.

On Wed, Apr 23, 2025 at 12:01 PM Devrim Gündüz <devrim(at)gunduz(dot)org> wrote:

> Hi,
>
> On Wed, 2025-04-23 at 11:48 -0500, Jim Nasby wrote:
> > unless we added multiple WAL streams. That would allow for splitting
> > WAL traffic across multiple devices as well as providing better
> > support for configurations that don’t replicate the entire cluster.
> > The current situation where delayed replication of a single table
> > mandates retention of all the WAL for the entire cluster is less than
> > ideal.
>
> I think the problem is handling the stream of global objects. Having
> separate stream for each database would be awesome as long as it can
> deal with the "global stream".
>
> Regards,
> --
> Devrim Gündüz
> Open Source Solution Architect, PostgreSQL Major Contributor
> BlueSky: @devrim.gunduz.org , @gunduz.org
>

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Jacob Champion 2025-04-29 20:26:43 Re: dispchar for oauth_client_secret
Previous Message Nathan Bossart 2025-04-29 18:09:32 Re: Large expressions in indexes can't be stored (non-TOASTable)