Skip site navigation (1) Skip section navigation (2)

Re: estimating # of distinct values

From: Josh Berkus <josh(at)agliodbs(dot)com>
To: tv(at)fuzzy(dot)cz
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: estimating # of distinct values
Date: 2010-12-29 23:47:56
Message-ID: (view raw, whole thread or download thread mbox)
Lists: pgsql-hackers
> Well, but that's not 7%, thats 7x! And the theorem says 'greater or equal'
> so this is actually the minimum - you can get a much bigger difference
> with lower probability. So you can easily get an estimate that is a few
> orders off.

FWIW, based on query performance, estimates which are up to 5X off are
tolerable, and anything within 3X is considered "accurate".  Above 5X
the probability of bad query plans becomes problematically high.

Of course, if you're doing cross-column stats, the accuracy of each
individual column becomes critical since estimation error could be
combiniational in the worst case (i.e. if colA is 3X and colB is 0.3X
then colA<->colB will be 9X off).

Anyway, I look forward to your experiments with stream-based estimators.

                                  -- Josh Berkus
                                     PostgreSQL Experts Inc.

In response to

pgsql-hackers by date

Next:From: Noah MischDate: 2010-12-29 23:52:42
Subject: Re: Avoiding rewrite in ALTER TABLE ALTER TYPE
Previous:From: Kevin GrittnerDate: 2010-12-29 23:46:55
Subject: SLRU API tweak

Privacy Policy | About PostgreSQL
Copyright © 1996-2017 The PostgreSQL Global Development Group