== PostgreSQL Weekly News - May 31, 2020 ==

== PostgreSQL Weekly News - May 31, 2020 ==

Person of the week: https://postgresql.life/post/paul_ramsey/

== PostgreSQL Product News ==

psqlODBC 12.02.0000 released.
https://odbc.postgresql.org/docs/release.html

PostgreSQL TDE 12.3, a fork of PostgreSQL which offers transparent data encryption, released.
https://www.cybertec-postgresql.com/en/products/postgresql-transparent-data-encryption/
pgAdmin4 4.22, a web- and native GUI control center for PostgreSQL, released.
https://www.pgadmin.org/docs/pgadmin4/dev/release_notes_4_22.html

Metagration a PostgreSQL migration tool written in PL/pgsql, released.
https://github.com/michelp/metagration

Veil2 beta, a database security add-on for Postgres that provides a framework
for implementing Virtual Private Databases with row level security, released.
https://marcmunro.github.io/veil2/html/index.html

== PostgreSQL Jobs for May ==

http://archives.postgresql.org/pgsql-jobs/2020-05/

== PostgreSQL Local ==

FOSS4G 2020, will take place in Calgary, Alberta, Canada August 24-29 2020.
the Call for Papers is currently open at https://2020.foss4g.org/speakers/
https://2020.foss4g.org/

PGDay Ukraine will take place September 5th, 2020 in Lviv at the Bank Hotel.
https://pgday.org.ua/

pgDay Israel 2020 will take place on September 10, 2020 in Tel Aviv.
http://pgday.org.il/

PGDay Austria will take place September 18, 2020 at Schloss Schoenbrunn
(Apothekertrakt) in Vienna.
https://pgday.at/en/

PostgreSQL Conference Europe 2020 will be held on October 20-23, 2020 in Berlin,
Germany. The CfP is open through July 31, 2020 at https://2020.pgconf.eu/callforpapers
https://2020.pgconf.eu/

PG Day Russia will take place in Saint Petersburg on July 9, 2021.
https://pgday.ru/en/2020/

== PostgreSQL in the News ==

Planet PostgreSQL: http://planet.postgresql.org/

PostgreSQL Weekly News is brought to you this week by David Fetter

Submit news and announcements by Sunday at 3:00pm PST8PDT to david(at)fetter(dot)org(dot)

== Applied Patches ==

Michaël Paquier pushed:

- Doc: Fix order of pg_shmem_allocations in system view list.
pg_shmem_allocations was in the wrong position with pg_stats. Author: Ian
Barwick Discussion:
https://postgr.es/m/de7279d4-7ea0-037f-d7d2-1161682339db@2ndquadrant.com
https://git.postgresql.org/pg/commitdiff/5832396432b1ce8349a0028b52295a9874014416

- Fix some mentions to memory units in postgresql.conf.sample. The default unit
for max_slot_wal_keep_size is megabytes. While on it, also change
temp_file_limit to use a more consistent wording. Reported-by: Jeff Janes,
Fujii Masao Author: Kyotaro Horiguchi Discussion:
https://postgr.es/m/CAMkU=1wWZhhjpwRFKJ9waQGxxROeC0P6UqPvb90fAaGz7dhoHA@mail.gmail.com
https://git.postgresql.org/pg/commitdiff/55ca50deb8ffaec3b81d83c9f54c94f7e519f3a6

- Fix some comments in xlogreader.h. segment_open and segment_close were
mentioned with incorrect names. Discussion:
https://postgr.es/m/20200525234944.GA1573@paquier.xyz
https://git.postgresql.org/pg/commitdiff/f93bb0ce64005c84e1d1d431eed31e0da4835078

- Doc: Mention about caveats of --concurrently on reindexdb page. The
documentation of REINDEX includes a complete description of CONCURRENTLY and
its advantages as well as its disadvantages, but reindexdb was not really
clear about all that. From discussion with Tom Lane, based on a report from
Andrey Klychkov. Discussion:
https://postgr.es/m/1590486572.205117372@f500.i.mail.ru Backpatch-through: 12
https://git.postgresql.org/pg/commitdiff/9b60c4b979bce060495e2b05ba01d1cc6bffdd2d

Noah Misch pushed:

- Add a temp-install prerequisite to top-level "check-tests". The target failed,
tested $PATH binaries, or tested a stale temporary installation. Commit
c66b438db62748000700c9b90b585e756dd54141 missed this. Back-patch to 9.5 (all
supported versions).
https://git.postgresql.org/pg/commitdiff/650eac8d7b6df7147ff4bb29b354510fe1929671

- Reconcile nodes/*funcs.c. The stmt_len changes do not affect behavior.
LimitPath has no other support functions, so that part changes only debugging
output.
https://git.postgresql.org/pg/commitdiff/587322de36921557fcfcfdd40291669c8ee46968

Bruce Momjian pushed:

- gss: add missing references to hostgssenc and hostnogssenc. These were missed
when these were added to pg_hba.conf in PG 12; updates docs and
pg_hba.conf.sample. Reported-by: Arthur Nascimento Bug: 16380 Discussion:
https://postgr.es/m/20200421182736.GG19613@momjian.us Backpatch-through: 12
https://git.postgresql.org/pg/commitdiff/ac5852fb3042a4562e8a8bab26aaa00fa8183068

- doc: PG 13 relnotes: update bool_plperl item. Reported-by: Daniel Gustafsson
Discussion: https://postgr.es/m/54F7560D-498A-4E51-BAA4-17D4AAB2AA57@yesql.se
Backpatch-through: master
https://git.postgresql.org/pg/commitdiff/d9101e9806e446a413bcef16d3ab65602ed028ad

Peter Eisentraut pushed:

- Add lcov exclusion markers to jsonpath scanner. This was done for all scanners
in 421167362242ce1fb46d6d720798787e7cd65aad but not added to the new one.
https://git.postgresql.org/pg/commitdiff/add4211600bfece1efb3d62befbc55b521790d76

- Message wording tweaks. Make the wording of new libpq messages more similar to
existing messages in the backend.
https://git.postgresql.org/pg/commitdiff/49223e106b0a43452d64b4e52719532012c81e25

- Remove some tabs in SQL code in C string literals. This is not handled
uniformly throughout the code, but at least nearby code can be consistent.
https://git.postgresql.org/pg/commitdiff/0a737be03cf7708e8e27f9596be3406275ec3d49

Jeff Davis pushed:

- Avoid fragmentation of logical tapes when writing concurrently. Disk-based
HashAgg relies on writing to multiple tapes concurrently. Avoid fragmentation
of the tapes' blocks by preallocating many blocks for a tape at once. No file
operations are performed during preallocation; only the block numbers are
reserved. Reviewed-by: Tomas Vondra Discussion:
https://postgr.es/m/20200519151202.u2p2gpiawoaznsv2%40development
https://git.postgresql.org/pg/commitdiff/896ddf9b3cd7dcf70e43f733ae8fec5dfe6e31af

Heikki Linnakangas pushed:

- Fix typo in test comment. The same comment was copied to a few different
places, with the same typo. Backpatch down to v11, where this typo was
introduced.
https://git.postgresql.org/pg/commitdiff/0099db4ce1a19038d0d837bf82a35c989332cc58

- Add missing error code to "cannot attach index ..." error.
ERRCODE_OBJECT_NOT_IN_PREREQUISITE_STATE was used in an ereport with the same
message but different errdetail a few lines earlier, so use that here as well.
Backpatch-through: 11
https://git.postgresql.org/pg/commitdiff/5b1c61e8b8f98f4a1c42856819b6dea600669f47

Joe Conway pushed:

- Add CHECK_FOR_INTERRUPTS() to the repeat() function. The repeat() function
loops for potentially a long time without ever checking for interrupts. This
prevents, for example, a query cancel from interrupting until the work is all
done. Fix by inserting a CHECK_FOR_INTERRUPTS() into the loop. Backpatch to
all supported versions. Discussion:
https://www.postgresql.org/message-id/flat/8692553c-7fe8-17d9-cbc1-7cddb758f4c6%40joeconway.com
https://git.postgresql.org/pg/commitdiff/887cdff4dcbdfbfdbf9a29dfad0edc09c6ec3398

- Initialize dblink remoteConn struct in all cases. Two of the members of rconn
were left uninitialized. When dblink_open() is called without an outer
transaction it handles the initialization for us, but with an outer
transaction it does not. Arrange for initialization in all cases. Backpatch to
all supported versions. Reported-by: Alexander Lakhin Discussion:
https://www.postgresql.org/message-id/flat/9bd0744f-5f04-c778-c5b3-809efe9c30c7%40joeconway.com#c545909a41664991aca60c4d70a10ce7
https://git.postgresql.org/pg/commitdiff/9003b76e169e8524f8d7c7547aded4749b9c39a1

Andres Freund pushed:

- llvmjit: Fix building against LLVM 11 by removing unnecessary include. LLVM
has removed this header, in the branch that will become llvm 11. But as it
turns out we didn't actually need it, so just remove it. Author: Jesse Zhang
<sbjesse(at)gmail(dot)com> Discussion:
https://postgr.es/m/CAGf+fX7bvtP0YXMu7pOsu_NwhxW6dArTkxb=jt7M2-UJkyJ_3g@mail.gmail.com
Backpatch: 11, where JIT support using llvm was introduced.
https://git.postgresql.org/pg/commitdiff/6a4a335b841520739b7b2f0e608acdf3b814daad

Fujii Masao pushed:

- doc: Update the layout of "Viewing Statistics" section. This commit updates
the "Viewing Statistics" section more like the existing catalogs chapter. -
Change its layout so that an introductory paragrap is put above the table
for each statistics view. Previously the explanations were below the
tables. - Separate each view to different section and add index terms for
them. Author: Fujii Masao Reviewed-by: Tom Lane Discussion:
https://postgr.es/m/6f8a482c-b3fa-4ed9-21c3-6d222a2cb87d@oss.nttdata.com
https://git.postgresql.org/pg/commitdiff/92f9468657f0916ce8589e13d5ebda60c7973c31

Tomáš Vondra pushed:

- Use CP_SMALL_TLIST for hash aggregate. Commit 1f39bce021 added disk-based hash
aggregation, which may spill incoming tuples to disk. It however did not
request projection to make the tuples as narrow as possible, which may mean
having to spill much more data than necessary (increasing I/O, pushing other
stuff from page cache, etc.). This adds CP_SMALL_TLIST in places that may use
hash aggregation - we do that only for AGG_HASHED. It's unnecessary for
AGG_SORTED, because that either uses explicit Sort (which already does
projection) or pre-sorted input (which does not need spilling to disk).
Author: Tomas Vondra Reviewed-by: Jeff Davis Discussion:
https://postgr.es/m/20200519151202.u2p2gpiawoaznsv2%40development
https://git.postgresql.org/pg/commitdiff/4cad2534da6d17067d98cf04be2dfc1bda8f2cd0

== Pending Patches ==

Dagfinn Ilmari Mannsåker sent in a patch to add missing cross-links to the
system catalog documentation.

Atsushi Torikoshi sent in another revision of a patch to expose the counters of
plancache to pg_prepared_statement.

Noah Misch sent in another revision of a patch to prevent excess
SimpleLruTruncate() deletion, and unlink less in SimpleLruTruncate(), as
insurance against bugs.

Noah Misch sent in another revision of a patch to Prevent concurrent
SimpleLruTruncate() for any given SLRU.

David Gilman sent in three more revisions of a patch to Scan all TOCs when
restoring a custom dump file without offsets, add an integration test for
out-of-order TOC requests in pg_restore, remove unused seek check in tar dump
format, and skip tables in pg_restore by seeking instead of reading.

Peter Eisentraut sent in two revisions of a patch to change default of
password_encryption to scram-sha-256.

Dilip Kumar sent in four more revisions of a patch to fix an infelicity between
logical_work_mem and logical streaming of large in-progress transactions.

Justin Pryzby sent in another revision of a patch to make pg_ls_* functions show
directories and shared filesets.

Kyotaro HORIGUCHI sent in another revision of a patch to move the callback-call
from ReadPageInternal to XLogReadRecord, move the page-reader out of
XLogReadRecord, remove globals readOff, readLen and readSegNo, and make
allocating the page buffer the responsibility of callers of XLogReadRecord.

Álvaro Herrera sent in three revisions of a patch to fix a bug that manifested
as log messages like "ERROR: could not read from hash-join temporary file:
Success".

Michaël Paquier sent in two revisions of a patch to fix a bug that manifested as
segmentation fault using currtid and partitioned tables.

Nathan Bossart sent in a patch to assert that ControlFileLock is held
exclusively in UpdateControlFile().

Grigory Kryachko sent in a patch to add amcheck verification for GiST and GIN.

Kyotaro HORIGUCHI sent in two revisions of a patch to change some comments in
postgresql.conf.sample to inform better an match reality.

Mark Dilger sent in a patch to implement a new 'pg' metacommand for the command
line which consolidates all the disparate postgres command line programs into
one.

Melanie Plageman sent in another revision of a patch to implement adaptive
Hashjoin.

Thomas Munro sent in another revision of a patch to implement WAL prefetch.

Markus Winand sent in a WIP patch to fix a bug related to collation strength.

Kyotaro HORIGUCHI sent in a patch to fix crash when starting physical
replication on logical connection by warning the client instead of crashing.

Daniel Gustafsson sent in a patch to catch a comment in be-secure-openssl.c up
to the fact that the hardcoded DH parameters moved.

David Rowley sent in a patch to refactor equal funcs to use macros specific to
the data type, and add an equalCompare() function to compare node types in order
to lay the groundwork for using a binary search tree structure for nodes.

Jeff Davis sent in a patch to add and use BufFilePrefetch.

Andrew Dunstan sent in another revision of a patch to fix the install tests
target for vpath builds.

Adrien Nayrat sent in a patch to fix an issue that manifested as pg_dump failing
to not dump public schema orders.

Daniel Gustafsson sent in a patch to add compatibility with OpenSSL 3.0.0.

Masahiko Sawada sent in another revision of a patch to implement an internal key
management system.

Martín Marqués sent in a patch to give permission to
pg_replication_origin_status().

Vik Fearing sent in a patch to add compatible defaults for LEAD/LAG.

Nathan Bossart sent in another revision of a patch to fix a race condition when
writing pg_control.