Re: Trying out libarchive for reading user-generated WAL tarballs

From: Thomas Munro <thomas(dot)munro(at)gmail(dot)com>
To: PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Trying out libarchive for reading user-generated WAL tarballs
Date: 2026-04-10 06:33:30
Message-ID: CA+hUKGLTbjOos4fE_ffpdrFnhLOH1a8eCpONxQ9MAE8SME+anA@mail.gmail.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Sun, Apr 5, 2026 at 2:42 PM Thomas Munro <thomas(dot)munro(at)gmail(dot)com> wrote:
> Perhaps that could be fixed if astreamer_file.c provided
> "astreamer_file_reader" with the same semantics, so that it could
> unconditionally call astreamer_pull(privateInfo->archive_streamer),
> instead of doing the read, push-into-stream itself? Just a thought.

That seems to work.

Attachment Content-Type Size
v2-0001-Provide-astreamer_plain_reader-for-reading-files.patch text/x-patch 6.3 KB
v2-0002-pg_waldump-Read-data-with-astreamer_plain_reader.patch text/x-patch 5.1 KB
v2-0003-libarchive-Add-configure-and-meson-options.patch text/x-patch 9.0 KB
v2-0004-libarchive-Provide-astreamer_libarchive_reader.patch text/x-patch 9.6 KB
v2-0005-fixup-Use-more-efficient-zero-copy-API.patch text/x-patch 4.2 KB
v2-0006-pg_waldump-Use-astreamer_libarchive_reader.patch text/x-patch 3.5 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Richard Guo 2026-04-10 06:58:31 Re: Bug: var_is_nonnullable() gives wrong results for old/new in RETURNING
Previous Message vignesh C 2026-04-10 06:29:23 Re: Support EXCEPT for ALL SEQUENCES publications