| From: | Fabien COELHO <coelho(at)cri(dot)ensmp(dot)fr> | 
|---|---|
| To: | Greg Stark <stark(at)mit(dot)edu> | 
| Cc: | Andres Freund <andres(at)2ndquadrant(dot)com>, Peter Geoghegan <pg(at)heroku(dot)com>, Josh Berkus <josh(at)agliodbs(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org> | 
| Subject: | Re: ANALYZE sampling is too good | 
| Date: | 2013-12-07 07:17:56 | 
| Message-ID: | alpine.DEB.2.10.1312070807350.6697@sto | 
| Views: | Whole Thread | Raw Message | Download mbox | Resend email | 
| Thread: | |
| Lists: | pgsql-hackers | 
> http://en.wikipedia.org/wiki/Cluster_sampling
> http://en.wikipedia.org/wiki/Multistage_sampling
>
> I suspect the hard part will be characterising the nature of the
> non-uniformity in the sample generated by taking a whole block. Some
> of it may come from how the rows were loaded (e.g. older rows were
> loaded by pg_restore but newer rows were inserted retail) or from the
> way Postgres works (e.g. hotter rows are on blocks with fewer rows in
> them and colder rows are more densely packed).
I would have thought that as VACUUM reclaims space it levels that issue in 
the long run and on average, so that it could be simply ignored?
> I've felt for a long time that Postgres would make an excellent test
> bed for some aspiring statistics research group.
I would say "applied statistics" rather than "research". Nevertheless I 
can ask my research statistician colleagues next door about their opinion 
on this sampling question.
-- 
Fabien.
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Amit Kapila | 2013-12-07 07:50:22 | Re: [bug fix] pg_ctl fails with config-only directory | 
| Previous Message | Álvaro Hernández Tortosa | 2013-12-07 03:28:51 | Re: RFC: programmable file format for postgresql.conf |