RE: [PoC] Non-volatile WAL buffer

From: Takashi Menjo <takashi(dot)menjou(dot)vg(at)hco(dot)ntt(dot)co(dot)jp>
To: 'Robert Haas' <robertmhaas(at)gmail(dot)com>, 'Heikki Linnakangas' <hlinnaka(at)iki(dot)fi>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: RE: [PoC] Non-volatile WAL buffer
Date: 2020-02-10 09:29:31
Message-ID: 000001d5dff4$995ed180$cc1c7480$
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-hackers

Dear hackers,

I made another WIP patchset to mmap WAL segments as WAL buffers. Note that this is not a non-volatile WAL buffer patchset but its competitor. I am measuring and analyzing the performance of this patchset to compare with my N.V.WAL buffer.

Please wait for a several more days for the result report...

Best regards,

Takashi Menjo <takashi(dot)menjou(dot)vg(at)hco(dot)ntt(dot)co(dot)jp>
NTT Software Innovation Center

> -----Original Message-----
> From: Robert Haas <robertmhaas(at)gmail(dot)com>
> Sent: Wednesday, January 29, 2020 6:00 AM
> To: Takashi Menjo <takashi(dot)menjou(dot)vg(at)hco(dot)ntt(dot)co(dot)jp>
> Cc: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>; pgsql-hackers(at)postgresql(dot)org
> Subject: Re: [PoC] Non-volatile WAL buffer
> On Tue, Jan 28, 2020 at 3:28 AM Takashi Menjo <takashi(dot)menjou(dot)vg(at)hco(dot)ntt(dot)co(dot)jp> wrote:
> > I think our concerns are roughly classified into two:
> >
> > (1) Performance
> > (2) Consistency
> >
> > And your "different concern" is rather into (2), I think.
> Actually, I think it was mostly a performance concern (writes triggering lots of reading) but there might be a
> consistency issue as well.
> --
> Robert Haas
> EnterpriseDB: The Enterprise PostgreSQL Company

Attachment Content-Type Size
0001-Preallocate-more-WAL-segments.patch application/octet-stream 3.3 KB
0002-Use-WAL-segments-as-WAL-buffers.patch application/octet-stream 34.9 KB
0003-Lazy-unmap-WAL-segments.patch application/octet-stream 1.9 KB
0004-Speculative-map-WAL-segments.patch application/octet-stream 1.6 KB
0005-Allocate-WAL-segments-to-utilize-hugepage.patch application/octet-stream 1.3 KB

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Dilip Kumar 2020-02-10 09:39:12 Re: PATCH: logical_work_mem and logical streaming of large in-progress transactions
Previous Message Floris Van Nee 2020-02-10 09:05:36 RE: Delaying/avoiding BTreeTupleGetNAtts() call within _bt_compare()