Re: POC: make mxidoff 64 bits

From: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>
To: Ashutosh Bapat <ashutosh(dot)bapat(dot)oss(at)gmail(dot)com>, Maxim Orlov <orlovmg(at)gmail(dot)com>
Cc: Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, Alexander Korotkov <aekorotkov(at)gmail(dot)com>, wenhui qiu <qiuwenhuifx(at)gmail(dot)com>, Postgres hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: POC: make mxidoff 64 bits
Date: 2025-12-08 13:02:11
Message-ID: 22d30907-03b0-47c7-b38e-5574e475a387@iki.fi
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 06/12/2025 01:36, Heikki Linnakangas wrote:
> On 05/12/2025 15:42, Ashutosh Bapat wrote:
>> + $newnode->start;
>> + my $new_dump = get_dump_for_comparison($newnode, "newnode_${tag}
>> _dump");
>> + $newnode->stop;
>>
>>
>> There is no code which actually looks at the multixact offsets here to
>> make sure that the conversion happened correctly. I guess the test
>> relies on visibility checks for that. Anyway, we need a comment
>> explaining why just comparing the contents of the table is enough to
>> ensure correct conversion. Better if we can add an explicit test that
>> the offsets were converted correctly. I don't have any idea of how to
>> do that right now, though. Maybe use pg_get_multixact_members()
>> somehow in the query to extract data out of the table?
>
> Agreed, the verification here is quite weak. I didn't realize that
> pg_get_multixact_members() exists! That might indeed be handy here, but
> I'm not sure how exactly to construct the test. A direct C function like
> test_create_multixact() in test_multixact.c would be handy here, but
> we'd need to compile and do run that in the old cluster, which seems
> difficult.

I added verification of all the multixids between oldest and next
multixid, using pg_get_multixact_members(). The test now calls
pg_get_multixact_members() for all updating multixids in the range,
before and after the upgrade, and compares the results.

The verification ignores locking-only multixids. Verifying their
correctness would need a little more code because they're not fully
preserved by the upgrade.

I also expanded the test to cover multixid wraparound. It only covered
mxoffset wraparound previously.

New patch set attached. Only test changes compared to patch set v28.

- Heikki

Attachment Content-Type Size
v29-0001-pg_resetwal-Reject-negative-and-out-of-range-arg.patch text/x-patch 6.9 KB
v29-0002-pg_resetwal-Use-separate-flags-for-whether-an-op.patch text/x-patch 13.7 KB
v29-0003-Move-pg_multixact-SLRU-page-format-definitions-t.patch text/x-patch 10.9 KB
v29-0004-FIXME-bump-catversion.patch text/x-patch 858 bytes
v29-0005-Widen-MultiXactOffset-to-64-bits.patch text/x-patch 103.9 KB
v29-0006-Add-runtime-checks-for-bogus-multixact-offsets.patch text/x-patch 2.6 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Matthias van de Meent 2025-12-08 13:18:54 Re: making tid and HOTness of UPDATE available to logical decoding plugins
Previous Message Amit Langote 2025-12-08 12:26:19 Re: SQL Property Graph Queries (SQL/PGQ)