RE: Commitfest 2021-11 Patch Triage - Part 2

From: Floris Van Nee <florisvannee(at)Optiver(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Daniel Gustafsson <daniel(at)yesql(dot)se>
Cc: PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: RE: Commitfest 2021-11 Patch Triage - Part 2
Date: 2021-11-09 19:28:32
Message-ID: db5f7a4af7a4401e9640b0f571142f86@opammb0562.comp.optiver.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

> Daniel Gustafsson <daniel(at)yesql(dot)se> writes:
> > 2773: libpq compression
> > =======================
> > This patch intended to provide libpq connection compression to
> > "replace SSL compression" which was doomed when the patch was
> written,
> > and have since been removed altogether. The initial approach didn't
> > get much traction but there was significant discussion and work, which
> > has since fizzled out. The patch has been updated but there hasn't
> > been meaningful review the past months, the last comments seem to
> > imply there being a fair amount of questionmarks left in here.
> > Robert, having been very involved in this do you have any thoughts on
> where we are and where to go (if at all IYO)?
>
> I'm not Robert, but I still have an opinion here, and that it's that this feature
> would at best be an attractive nuisance. If you need compression on a
> database session, it probably means that the connection is over the open
> internet, which means that you need encryption even more. And we know
> that compression and encryption do not play well together. The reason
> compression was taken out of the latest TLS standards is not that they
> wouldn't have liked to have it, nor that applying compression in a separate
> code layer would be any safer. I fear offering this would merely lead people
> to build CVE-worthy setups.
>

I don't have a strong opinion on the patch but I'd just like to mention that there are definitely use cases for using compression on private networks (with ssl off). We have cases where we have a PG extension that hooks into the COPY ... FROM command and accept lz4-compressed data for the COPY data message specifically. This has proven invaluable to us even on private networks, because it can give a good compression ratio for very little CPU decompression overhead.

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Robert Haas 2021-11-09 19:36:06 Re: refactoring basebackup.c
Previous Message Robert Haas 2021-11-09 19:15:51 Re: removing global variable ThisTimeLineID