Re: Direction for test frameworks: Perl TAP vs. Python/pytest

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Aleksander Alekseev <aleksander(at)tigerdata(dot)com>
Cc: PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, Heikki Linnakangas <hlinnaka(at)iki(dot)fi>, Andrew Dunstan <andrew(at)dunslane(dot)net>
Subject: Re: Direction for test frameworks: Perl TAP vs. Python/pytest
Date: 2026-06-16 15:31:47
Message-ID: 699578.1781623907@sss.pgh.pa.us
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Aleksander Alekseev <aleksander(at)tigerdata(dot)com> writes:
>> I'm not super attracted to the idea of back-patching a whole new test
>> framework into stable branches. But the alternatives are not pretty
>> either --- eg, who will want to write a python test and then translate
>> it to perl for the back branches?

> That's a fair concern. It seems to me that back-patching TAP tests
> doesn't happen too often. Also modern LLM agents should be quite good
> at it.

I think you're underestimating the frequency with which we back-patch
test changes. Looking just at the v17 branch back to 1 January,
I see four commits that added entirely new *.pl test files, and
another 16 that modified one, plus four more that touched test
infrastructure (*.pm files). So that's nearly 10% of the total
commit traffic in that branch (262 commits). We're going to need
to deal with this on a very regular basis. Maybe we can wave it
all away with "AI will save us", but I've got doubts.

regards, tom lane

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2026-06-16 15:40:43 Re: Direction for test frameworks: Perl TAP vs. Python/pytest
Previous Message Baji Shaik 2026-06-16 15:25:52 Fix --missing-stats-only false positive for partitioned expression indexes