Re: compression libraries and CF bot

From: Thomas Munro <thomas(dot)munro(at)gmail(dot)com>
To: Justin Pryzby <pryzby(at)telsasoft(dot)com>
Cc: Dilip Kumar <dilipbalaut(at)gmail(dot)com>, Andrey Borodin <x4mmm(at)yandex-team(dot)ru>, Daniil Zakhlystov <usernamedt(at)yandex-team(dot)ru>, Konstantin Knizhnik <k(dot)knizhnik(at)postgrespro(dot)ru>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: compression libraries and CF bot
Date: 2021-01-19 21:29:05
Message-ID: CA+hUKGJQT9fAMknVPP06DcyGFP7voNXJf5m=XOy_T2S5VKTfiQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, Jan 20, 2021 at 9:56 AM Justin Pryzby <pryzby(at)telsasoft(dot)com> wrote:
> Do you know if the old travis build environment had liblz4 installed ?

It sounds like it.

> I'm asking regarding Dilip's patch, which was getting to "check world" 2 weeks
> ago but now failing to even compile, not apparently due to any change in the
> patch. Also, are the historic logs available somewhere ?
> http://cfbot.cputube.org/dilip-kumar.html

I can find some of them but not that one, because Travis's "branches"
page truncates well before our ~250 active branches, and that one
isn't in there.

https://travis-ci.org/github/postgresql-cfbot/postgresql/branches

> Also, what's the process for having new libraries installed in the CI
> environment ?

I have added lz4 to the FreeBSD and Ubuntu build tasks, so we'll see
if that helps at the next periodic build or when a new patch is
posted. It's failing on Windows because there is no HAVE_LIBLZ4 in
Solution.pm, and I don't know how to install that on a Mac. Is this
patch supposed to be adding a new required dependency, or a new
optional dependency?

In general, you could ask for changes here, or send me a pull request for eg:

https://github.com/macdice/cfbot/blob/master/cirrus/.cirrus.yml

If we eventually think the CI control file is good enough, and can get
past the various political discussions required to put CI
vendor-specific material in our tree, it'd be just a regular patch
proposal and could even be tweaked as part of a feature submission.

> There's 3 compression patches going around, so I think eventually we'll ask to
> get libzstd-devel (for libpq and pg_dump) and liblz4-devel (for toast and
> libpq). Maybe all compression methods would be supported in each place - I
> hope the patches will share common code.

+1, nice to see modern compression coming to PostgreSQL.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2021-01-19 21:33:19 Re: compression libraries and CF bot
Previous Message Tom Lane 2021-01-19 21:22:51 Re: Printing backtrace of postgres processes