CI and test improvements

From: Justin Pryzby <pryzby(at)telsasoft(dot)com>
To: Andres Freund <andres(at)anarazel(dot)de>, Andrew Dunstan <andrew(at)dunslane(dot)net>, Thomas Munro <thomas(dot)munro(at)gmail(dot)com>
Cc: Noah Misch <noah(at)leadboat(dot)com>, Michael Paquier <michael(at)paquier(dot)xyz>, Jacob Champion <pchampion(at)vmware(dot)com>, Anastasia Lubennikova <lubennikovaav(at)gmail(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Robert Haas <robertmhaas(at)gmail(dot)com>, Melanie Plageman <melanieplageman(at)gmail(dot)com>, Peter Eisentraut <peter(dot)eisentraut(at)enterprisedb(dot)com>, Daniel Gustafsson <daniel(at)yesql(dot)se>, pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: CI and test improvements
Date: 2022-05-28 15:37:41
Message-ID: 20220528153741.GK19626@telsasoft.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

I'm "joining" a bunch of unresolved threads hoping to present them better since
they're related and I'm maintaining them together anyway.

https://www.postgresql.org/message-id/flat/20220219234148.GC9008%40telsasoft.com
- set TESTDIR from perl rather than Makefile
https://www.postgresql.org/message-id/flat/20220522232606.GZ19626%40telsasoft.com
- ccache, MSVC, and meson
https://www.postgresql.org/message-id/20220416144454.GX26620%40telsasoft.com
- Re: convert libpq uri-regress tests to tap test
https://www.postgresql.org/message-id/CA%2BhUKGLneD%2Bq%2BE7upHGwn41KGvbxhsKbJ%2BM-y9nvv7_Xjv8Qog%40mail.gmail.com
- Re: A test for replay of regression tests
https://www.postgresql.org/message-id/flat/20220409021853(dot)GP24419(at)telsasoft(dot)com
- cfbot requests

See the commit messages for more thread references.

I'm anticipating the need to further re-arrange the patch set - it's not clear
which patches should go first. Maybe some patches should be dropped in favour
of the meson project. I guess some patches will have to be re-implemented with
meson (msvc warnings).

I think there was some confusion about the vcregress "alltaptests" target.
I said that it's okay to add it and make cirrus use it (and that the buildfarm
could use it too). Andrew responded that the buildfarm wants to run different
tests separately. But Andres seems to have interpretted that as an objection
to the addition of an "alltaptests" target, which I think isn't what's
intended - it's fine if the buildfarm prefers not to use it.

Maybe the improvements to vcregress should go into v15 ? CI should run all the
tests (which also serves to document *how* to run all the tests, even if there
isn't a literal check-world target).

Attachment Content-Type Size
0001-cirrus-windows-add-compiler_warnings_script.patch text/x-diff 2.5 KB
0002-cirrus-vcregress-test-modules-contrib-with-NO_INSTAL.patch text/x-diff 8.0 KB
0003-set-TESTDIR-from-src-test-perl-rather-than-Makefile-.patch text/x-diff 4.2 KB
0004-s-also-remove-PATH.patch text/x-diff 3.6 KB
0005-cirrus-macos-enable-various-runtime-checks.patch text/x-diff 1.3 KB
0006-cirrus-linux-compile-with-fsanitize.patch text/x-diff 1.1 KB
0007-cirrus-windows-increase-timeout-to-25min.patch text/x-diff 1.1 KB
0008-vcregress-add-alltaptests.patch text/x-diff 4.4 KB
0009-tmp-run-tap-tests-first.patch text/x-diff 1.2 KB
0010-vcregress-run-alltaptests-in-parallel.patch text/x-diff 5.6 KB
0011-cirrus-make-DebugInformationFormat-OldStyle-for-CI-b.patch text/x-diff 2.4 KB
0012-cirrus-windows-ccache.patch text/x-diff 2.3 KB
0013-another-way-to-install-uri-regress-uri_regress.patch text/x-diff 3.8 KB
0014-Move-libpq_pipeline-test-into-src-interfaces-libpq.patch text/x-diff 9.0 KB
0015-msvc-do-not-install-libpq-test-tools-by-default.patch text/x-diff 2.2 KB
0016-cirrus-code-coverage.patch text/x-diff 3.1 KB
0017-cirrus-build-docs-as-a-separate-task.patch text/x-diff 2.0 KB
0018-cirrus-upload-changed-html-docs-as-artifacts.patch text/x-diff 2.5 KB
0019-f-html-index-file.patch text/x-diff 2.1 KB

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Roffild 2022-05-28 15:49:43 Re: postgres and initdb not working inside docker
Previous Message Tom Lane 2022-05-28 15:37:30 Re: [PATCH] Support % wildcard in extension upgrade filenames