Re: plpython tests fail against python 3.14 under Valgrind

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Alexander Lakhin <exclusion(at)gmail(dot)com>
Cc: pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>, Andres Freund <andres(at)anarazel(dot)de>
Subject: Re: plpython tests fail against python 3.14 under Valgrind
Date: 2026-08-11 20:57:02
Message-ID: 2541685.1786481822@sss.pgh.pa.us
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

I wrote:
> Anyway, I've confirmed that the attached patch makes the problem
> go away here. Unless somebody wants to expend brain cells on
> running the underlying issue to ground, I think we should just
> apply this to the back branches and be happy. A variant plan
> could be to do it like this #ifdef USE_VALGRIND and otherwise
> keep the old code, but that seems unduly paranoid to me.

A bit of excavation in our git history reminded me that our old
behavior here was very intentional:

Author: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Branch: master Release: REL9_6_BR [62c8421e8] 2016-07-07 11:28:17 -0400

Reduce stack space consumption in tzload().

While syncing our timezone code with IANA's updates in commit 1c1a7cbd6,
I'd chosen not to adopt the code they conditionally compile under #ifdef
ALL_STATE. The main thing that that drives is that the space for gmtime
and localtime timezone definitions isn't statically allocated, but is
malloc'd on first use. I reasoned we didn't need that logic: we don't have
localtime() at all, and we always initialize TimeZone to GMT so we always
need that one. But there is one other thing ALL_STATE does, which is to
make tzload() malloc its transient workspace instead of just declaring it
as a local variable. It turns out that that local variable occupies 78K.
Even worse is that, at least for common US timezone settings, there's a
recursive call to parse the "posixrules" zone name, making peak stack
consumption to select a time zone upwards of 150K. That's an uncomfortably
large fraction of our STACK_DEPTH_SLOP safety margin, and could result in
outright crashes if we try to reduce STACK_DEPTH_SLOP as has been discussed
recently. Furthermore, this means that the postmaster's peak stack
consumption is several times that of a backend running typical queries
(since, except on Windows, backends inherit the timezone GUC values and
don't ever run this code themselves unless you do SET TIMEZONE). That's
completely backwards from a safety perspective.

Hence, adopt the ALL_STATE rather than non-ALL_STATE variant of tzload(),
while not changing the other code aspects that symbol controls. The
risk of an ENOMEM error from malloc() seems less than that of a SIGSEGV
from stack overrun.

Now, we deleted the "posixrules" recursion logic in v13, so in all
active branches the amount of stack space required is 70-something K
not twice that. But re-reading this message, the postmaster
vs. backends point still seems like a compelling safety argument.
So I'd rather make master work like the old code instead of vice
versa.

Hence, what I'm now thinking is to malloc the space by default,
but use a stack allocation if USE_VALGRIND, with a comment explaining
that that masks an obscure valgrind-or-possibly-python bug; and to
do it the same way in all branches.

regards, tom lane

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Andres Freund 2026-08-11 20:57:35 Re: [PATCH] bufmgr: tighten LWLock:BufferMapping on InvalidateBuffer
Previous Message Andres Freund 2026-08-11 20:50:08 Re: Restructured Shared Buffer Hash Table