Re: Trying to break online checksums with LLMs

From: Daniel Gustafsson <daniel(at)yesql(dot)se>
To: Robert Haas <robertmhaas(at)gmail(dot)com>
Cc: PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>, Heikki Linnakangas <hlinnaka(at)iki(dot)fi>, rmt(at)lists(dot)postgresql(dot)org
Subject: Re: Trying to break online checksums with LLMs
Date: 2026-09-14 21:59:15
Message-ID: 2E653E01-2059-4536-9E8F-FF15B956C4F7@yesql.se
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

> On 14 Sep 2026, at 21:59, Robert Haas <robertmhaas(at)gmail(dot)com> wrote:

> It's for the RMT to decide whether that's good enough, but I'm
> skeptical. I think a big part of the problem here is that it's really
> hard to make something race-free.

Once the cluster has moved to inprogress-on, any new orphan files will have
checksums written. This means that if the launcher can get a list of orphan
files once the state has changed, there cannot be any more created (without
checksums) during processing. There can still be new orphan files *with*
checksums written, but those would be no different from what we have today with
pg_checksums processing.

This reduction in problem scope likely means we can avoid the race conditions
that such scans are usually subject to. This is back-of-napkin sketching but I
think this invariant of the orphan files problem is less hard than the generic
one.

But at any rate, this is clearly not the time to design that.

If we revert we should keep online checksums in master and only pull it out of
19, to allow for this to be fixed early in 20, and avoid the churn. I held off
from backpatching the open item fix for this very reason; unless I hear
otherwise by Wednesday I'll go ahead with the revert, else the backpatch.
Adding RMT to the thread to keep everyone in the loop.

--
Daniel Gustafsson

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Michael Paquier 2026-09-14 23:04:33 Re: Translation of the NextOID message in pg_controldata
Previous Message shihao zhong 2026-09-14 21:48:07 Re: Add TOAST statistics columns to pg_stat_all_tables