From: | Andres Freund <andres(at)anarazel(dot)de> |
---|---|
To: | pgsql-hackers(at)postgresql(dot)org |
Subject: | ci: reduce macos test concurrency |
Date: | 2022-09-27 04:02:08 |
Message-ID: | 20220927040208.l3shfcidovpzqxfh@awork3.anarazel.de |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
Hi,
The x86 mac VMs from cirrus-ci claim to have 12 CPUs, but when working on
initdb caching for tests I noticed that using all those CPUs for tests hurts
the test times noticably.
See [1] (note that the overall time is influenced by different degrees of
cache hit ratios):
concurrency test time:
4 05:58
6 05:09
8 04:58
10 05:58
12 (current) 06:58
There's a fair bit of run-to-run variance, but the rough shape of these
looks repeatable.
I suspect the VMs might be overcommitted a fair bit - or macos just scales
poorly. Cirrus-ci apparently is switching to M1 based macs, which could be
related. It'd be good for us do that switch, as it'd give use ARM coverage for
CI / cfbot. See also [3].
In 15 (and thus autoconf) the timings differ a bit less [2]:
concurrency test time:
4 06:54
6 05:43
8 06:09
10 06:01
12 (current) 06:38
Looks like changing TEST_JOBS=6 or 8 would be a good idea.
Greetings,
Andres Freund
[1] https://cirrus-ci.com/build/5254074546257920
[2] https://cirrus-ci.com/task/4888800445857792
[3] https://postgr.es/m/CAN55FZ2R%2BXufuVgJ8ew_yDBk48PgXEBvyKNvnNdTTVyczbQj0g%40mail.gmail.com
From | Date | Subject | |
---|---|---|---|
Next Message | Thomas Munro | 2022-09-27 04:29:27 | Re: [RFC] building postgres with meson - v13 |
Previous Message | Kyotaro Horiguchi | 2022-09-27 03:34:25 | Re: Make ON_ERROR_STOP stop on shell script failure |