Re: Use extended statistics to estimate (Var op Var) clauses

From: Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>
To: Mark Dilger <mark(dot)dilger(at)enterprisedb(dot)com>
Cc: Dean Rasheed <dean(dot)a(dot)rasheed(at)gmail(dot)com>, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Use extended statistics to estimate (Var op Var) clauses
Date: 2021-08-20 19:25:22
Message-ID: 5b045793-f412-abca-45c5-4cffadbf54f3@enterprisedb.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 8/18/21 12:43 PM, Tomas Vondra wrote:
> Hi Mark,
>
> This thread inspired me to do something fairly similar - a generator
> that generates queries of varying complexity, executes them on table
> with and without extended statistics. I've been thinking about that
> before, but this finally pushed me to do that, and some of the results
> are fairly interesting ...
>
> I've pushed everything (generator and results) to this github repo:
>
>   https://github.com/tvondra/stats-test
>
> with a summary of all results here:
>
>   https://github.com/tvondra/stats-test/blob/master/results.md
>

FWIW I've pushed slightly reworked scripts and results - there are
results from two machines - xeon and i5. Xeon is mostly the same as
before, with some minor fixes, while i5 is does not allow clauses
referencing the same column twice (per discussion in this thread).

I think there was a bug in the original plot script, combining incorrect
data series in some cases, causing (at least) some of the strange
patterns mentioned.

I've also made the charts easier to read by splitting the cases into
separate plots and using transparency. I've also added png version back,
because plotting the .svg is quite slow.

regards

--
Tomas Vondra
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Justin Pryzby 2021-08-20 19:27:20 Re: pgstat_send_connstats() introduces unnecessary timestamp and UDP overhead
Previous Message Robert Haas 2021-08-20 19:20:16 Re: The Free Space Map: Problems and Opportunities