Re: fdatasync performance problem with large number of DB files

From: Thomas Munro <thomas(dot)munro(at)gmail(dot)com>
To: Fujii Masao <masao(dot)fujii(at)oss(dot)nttdata(dot)com>
Cc: Bruce Momjian <bruce(at)momjian(dot)us>, Paul Guo <guopa(at)vmware(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Michael Brown <michael(dot)brown(at)discourse(dot)org>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: fdatasync performance problem with large number of DB files
Date: 2021-03-19 01:37:11
Message-ID: CA+hUKG+jOK-0ZbCAiTwPx8_ajfRs9cAgkFf4BodfQiE9G+3n1w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Mar 19, 2021 at 2:16 PM Thomas Munro <thomas(dot)munro(at)gmail(dot)com> wrote:
> PS: For illustration/discussion, I've also attached a "none" patch. I
> also couldn't resist rebasing my "wal" mode patch, which I plan to
> propose for PG15 because there is not enough time left for this
> release.

Erm... I attached the wrong version by mistake. Here's a better one.
(Note: I'm not expecting any review of the 0003 patch in this CF, I
just wanted to share the future direction I'd like to consider for
this problem.)

Attachment Content-Type Size
v5-0001-Provide-recovery_init_sync_method-syncfs.patch text/x-patch 10.9 KB
v5-0002-Provide-recovery_init_sync_method-none.patch text/x-patch 3.7 KB
v5-0003-Provide-recovery_init_sync_method-wal.patch text/x-patch 16.7 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Geoghegan 2021-03-19 01:42:25 Re: New IndexAM API controlling index vacuum strategies
Previous Message Tomas Vondra 2021-03-19 01:29:04 Re: WIP: WAL prefetch (another approach)