Re: CI slowdown due to PG_TEST_INITDB_EXTRA_OPTS

From: Jakub Wartak <jakub(dot)wartak(at)enterprisedb(dot)com>
To: Jelte Fennema-Nio <postgres(at)jeltef(dot)nl>
Cc: Andres Freund <andres(at)anarazel(dot)de>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, pgsql-hackers(at)postgresql(dot)org, Peter Eisentraut <peter(dot)eisentraut(at)enterprisedb(dot)com>, Nazir Bilal Yavuz <byavuz81(at)gmail(dot)com>
Subject: Re: CI slowdown due to PG_TEST_INITDB_EXTRA_OPTS
Date: 2026-08-13 10:09:59
Message-ID: CAKZiRmyS4xdXt4NMhp8OvB0i01g4WmEc2AeNq6hUQ=K7fzO9wg@mail.gmail.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Tue, Aug 11, 2026 at 2:39 PM Jelte Fennema-Nio <postgres(at)jeltef(dot)nl> wrote:
>
> On Tue, 21 Jul 2026 at 02:56, Andres Freund <andres(at)anarazel(dot)de> wrote:
> >
> > Hi,
> >
> > On 2026-07-20 23:47:16 +0200, Jelte Fennema-Nio wrote:
> > > On Sat, 18 Jul 2026 at 20:48, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:
> > > > It looks like any one job mostly uses the same value of
> > > > PG_TEST_INITDB_EXTRA_OPTS. Could we record what was used to set up
> > > > the template, and allow using it if that matches?
> >
> > That seems like a somewhat complicated mechanism. But mainly I feel like it's
> > a workaround around the config-customization-via-env-var having to go through
> > exactly one file. None of the uses of PG_TEST_INITDB_EXTRA_OPTS in CI actually
> > needs it to be an initdb option, it's just a way to set configuration options
> > for the server via an environment variable.
> >
> > I wonder if the best thing would be to add PG_TEST_SERVER_POSTGRES_OPTS or
> > such, which Cluster.pm and regress.c would add to postgresql.conf.
>
> I don't think it's that complicated. But I'd be fine with
> PG_TEST_SERVER_POSTGRES_OPTS as well. That has the downside that it
> won't work for actual initdb options, but at least CI doesn't use that
> (for now). Some buildfarm members might though.

Hi,

I've scheduled 3 runs on 3 consecutive days (w/o and with v2 patch by Nazir),
[in minutes, from/master -> branch/w patch]
autoconf 23 -> 17, 21 -> 10, 20 -> 16
meson32 16 -> 14, 16 -> 9, 15 -> 13
meson64 29 -> 22, 28 -> 18, 28 -> 22
macOS 28 -> 25, 21 -> 17, 21 -> 20
mingw 22 -> 27?,25 -> 23, 28 -> 26
warnings 32 -> 30, 23 -> 3?, 27 -> 24
winvc1 18 -> 19, 19 -> 26, 16 -> 16
winvc2 17 -> 17, 17 -> 14, 17 -> 16

Take the results with some degree of doubt (I have no idea what is
infrastructure underneath; how overscribed the CPUs were etc.), but those
are consistent, real gains for Linux builds (-33% autoconf, -27% meson32,
23% meson64) during 3 days.

> I was once more wondering why CI is so slow. [..]

Cheer up gents, altough it's like ~ < 25min, I find the full CI of PostgreSQL
still the fastest thing I have ever worked with and it's free. From what
I've worked with, heard or read in terms of complex software/systems it's
leaving the rest of world in the dust in terms of how lightweight/fast it
is ... [one can have it even faster on your hardware if one wants -- using
runners].

-J.

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Daniel Gustafsson 2026-08-13 10:17:16 Re: pg_control_checkpoint(): add "data_checksum_version" (Pg19)?
Previous Message shveta malik 2026-08-13 09:53:07 Re: Support EXCEPT for TABLES IN SCHEMA publications