Re: Can we get rid of repeated queries from pg_dump?

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, depesz(at)depesz(dot)com, Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>, pgsql-general <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Can we get rid of repeated queries from pg_dump?
Date: 2021-08-29 19:47:11
Message-ID: 20210829194711.GB17906@tamriel.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

Greetings,

* Tom Lane (tgl(at)sss(dot)pgh(dot)pa(dot)us) wrote:
> Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org> writes:
> > Another pointlessly repetitive query is in getTriggers, which we run
> > once per table to be dumped containing triggers. We could reduce that
> > by running it in bulk for many relations at a time. I suppose it's
> > normally not hurtful, but as we grow the number of partitions we allow
> > it's going to become a problem.
>
> Perhaps. In the regression database, only ~10% of the tables have
> triggers, so it's likely not going to yield any measurable gain there.
> But databases that make heavier use of foreign keys might see a win.

It sure seems like in just about all cases fewer queries is going to be
better.

> Another thing I've wondered about before is whether it could make sense
> to read pg_attribute once rather than once per table. There might be
> a fair amount of wasted work if the dump is selective, and in big DBs
> the sheer size of that result could be a problem. But those reads are
> definitely way up there on the number-of-queries scale.

Yeah, I've thought about this before too. Would sure be nice if there
was a way that we could query the catalog selectively based on the
options the user has passed in but do so in as few queries as possible.

Thanks,

Stephen

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Mladen Gogala 2021-08-29 20:35:47 Re: database design with temporary tables
Previous Message Adrian Klaver 2021-08-29 18:26:25 Re: database design with temporary tables

Browse pgsql-hackers by date

  From Date Subject
Next Message Pavel Stehule 2021-08-29 20:46:47 Re: Schema variables - new implementation for Postgres 15
Previous Message Osahon Oduware 2021-08-29 17:42:16 Re: FYA: VITAL INFO