Re: Relation bulk write facility

From: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>
To: Thomas Munro <thomas(dot)munro(at)gmail(dot)com>, Noah Misch <noah(at)leadboat(dot)com>
Cc: Andres Freund <andres(at)anarazel(dot)de>, Peter Smith <smithpb2250(at)gmail(dot)com>, Robert Haas <robertmhaas(at)gmail(dot)com>, vignesh C <vignesh21(at)gmail(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>, Melanie Plageman <melanieplageman(at)gmail(dot)com>
Subject: Re: Relation bulk write facility
Date: 2024-02-25 14:34:47
Message-ID: 31db8d41-2ac9-4b5e-b7a8-712d6d7d7aa2@iki.fi
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 25/02/2024 00:37, Thomas Munro wrote:
> On Sun, Feb 25, 2024 at 11:16 AM Thomas Munro <thomas(dot)munro(at)gmail(dot)com> wrote:
>> On Sun, Feb 25, 2024 at 11:06 AM Heikki Linnakangas <hlinnaka(at)iki(dot)fi> wrote:
>>> Regarding the issue at hand, perhaps we should define PG_IO_ALIGN_SIZE as 16 on AIX, if that's the best the linker can do on that platform.
>>
>> You'll probably get either an error or silently fall back to buffered
>> I/O, if direct I/O is enabled and you try to read/write a badly
>> aligned buffer. That's documented (they offer finfo() to query it,
>> but it's always 4KB for the same sort of reasons as it is on every
>> other OS).
>
> I guess it's the latter ("to work efficiently" sounds like it isn't
> going to reject the request):
>
> https://www.ibm.com/docs/en/aix/7.3?topic=tuning-direct-io
>
> If you make it < 4KB then all direct I/O would be affected, not just
> this one place, so then you might as well just not allow direct I/O on
> AIX at all, to avoid giving a false impression that it does something.
> (Note that if we think the platform lacks O_DIRECT we don't make those
> assertions about alignment).
>
> FWIW I'm aware of one other thing that is wrong with our direct I/O
> support on AIX: it should perhaps be using a different flag. I
> created a wiki page to defer thinking about any AIX issues
> until/unless at least one real, live user shows up, which hasn't
> happened yet: https://wiki.postgresql.org/wiki/AIX

Here's a patch that effectively disables direct I/O on AIX. I'm inclined
to commit this as a quick fix to make the buildfarm green again.

I agree with Andres though, that unless someone raises their hand and
volunteers to properly maintain the AIX support, we should drop it. The
current AIX buildfarm members are running AIX 7.1, which has been out of
support since May 2023
(https://www.ibm.com/support/pages/aix-support-lifecycle-information).
See also older thread on this [0].

Noah, you're running the current AIX buildfarm animals. How much effort
are you interested to put into AIX support?

[0]
https://www.postgresql.org/message-id/20220702183354.a6uhja35wta7agew%40alap3.anarazel.de

--
Heikki Linnakangas
Neon (https://neon.tech)

Attachment Content-Type Size
0001-Disable-O_DIRECT-on-AIX.patch text/x-patch 3.3 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2024-02-25 16:16:07 Re: Running the fdw test from the terminal crashes into the core-dump
Previous Message Tomas Vondra 2024-02-25 13:52:47 Re: Optimize planner memory consumption for huge arrays