Re: PoC: pg_dump --filter-data <file> (like Oracle Where Clause on RMAN for specific tables)

From: Kirk Wolak <wolakk(at)gmail(dot)com>
To: Greg Sabino Mullane <htamfids(at)gmail(dot)com>
Cc: PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>, Andrey Borodin <x4mmm(at)yandex-team(dot)ru>, Nikolay Samokhvalov <nik(at)postgres(dot)ai>, Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com>, Pavlo Golub <Pavlo(dot)Golub(at)cybertec(dot)at>
Subject: Re: PoC: pg_dump --filter-data <file> (like Oracle Where Clause on RMAN for specific tables)
Date: 2025-08-16 22:56:12
Message-ID: CACLU5mS+iopX196gK_+6XfPisvhoKiZX+xKhnfXg4b+ZqPEZcg@mail.gmail.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Aug 15, 2025 at 1:25 PM Greg Sabino Mullane <htamfids(at)gmail(dot)com>
wrote:

> I've seen this idea pop up over the years, and it's still a good one.
> Rather than invent new flags, I think a better approach would be to
> convince pg_dump to dump a view, such that table foo has a view fooslice to
> limit / filter the output. Then we can simply do:
>
> pg_dump -t foo=view:fooslice
> ..
> While we could make the view mapping into a separate filtering file as you
> suggest, that's more complexity and also a little more dangerous in an
> action-at-a-distance way, so I'd rather have people be very specific in the
> mapping on the command line.
>

Hmmm, first, we are talking a full pg_dump, with some data filtering, I
don't think we can avoid adding some kind of switch. While being able to
do it on the command line is great for 1 table or 2... it gets unwieldy
pretty quickly. Also, changing this inside of a production environment to
maintain the slices when different "dumps" have different parameters (our
monthly dump goes back 35 days), so for us, having different files with
different settings makes the most sense.

But this is why I am asking for input/feedback. The feedback is producing
ideas...

Thanks!

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Sami Imseih 2025-08-17 03:18:05 Re: Improve LWLock tranche name visibility across backends
Previous Message Kirk Wolak 2025-08-16 22:48:41 Re: PoC: pg_dump --filter-data <file> (like Oracle Where Clause on RMAN for specific tables)