From:
Greg Smith <gsmith(at)gregsmith(dot)com>
To:
Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc:
Robert Haas <robertmhaas(at)gmail(dot)com>,
Gregory Stark <stark(at)enterprisedb(dot)com>,
Kevin Grittner <Kevin(dot)Grittner(at)wicourts(dot)gov>,
"jd(at)commandprompt(dot)com" <jd(at)commandprompt(dot)com>,
Josh Berkus <josh(at)agliodbs(dot)com>, pgsql-hackers(at)postgresql(dot)org
Subject:
Re: benchmarking the query planner
Date:
2009-01-02 11:17:29
Message-ID:
Pine.GSO.4.64.0901020554260.193@westnet.com (view raw or flat )
Thread:
2008-12-06 18:19:05 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-06 19:13:54 from Greg Stark <greg(dot)stark(at)enterprisedb(dot)com>
2008-12-08 16:56:06 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-08 17:02:14 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-10 04:25:01 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-10 17:58:52 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 02:28:25 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-11 18:09:28 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 18:53:35 from "Vladimir Sitnikov" <sitnikov(dot)vladimir(at)gmail(dot)com>
2008-12-11 19:06:32 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 19:31:25 from "Vladimir Sitnikov" <sitnikov(dot)vladimir(at)gmail(dot)com>
2008-12-11 20:06:12 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-11 19:04:17 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-11 20:57:22 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 21:19:35 from "Vladimir Sitnikov" <sitnikov(dot)vladimir(at)gmail(dot)com>
2008-12-11 21:28:28 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 21:54:43 from "Vladimir Sitnikov" <sitnikov(dot)vladimir(at)gmail(dot)com>
2008-12-11 22:27:00 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 22:47:08 from "Vladimir Sitnikov" <sitnikov(dot)vladimir(at)gmail(dot)com>
2008-12-12 00:12:35 from "Nathan Boley" <npboley(at)gmail(dot)com>
2008-12-12 00:30:16 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 01:35:18 from "Nathan Boley" <npboley(at)gmail(dot)com>
2008-12-12 01:50:10 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 02:39:56 from "Nathan Boley" <npboley(at)gmail(dot)com>
2008-12-12 16:25:10 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2008-12-12 16:35:57 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-12 17:00:23 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2008-12-12 18:11:42 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 18:15:00 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-12-12 17:27:59 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2008-12-12 18:44:56 from Euler Taveira de Oliveira <euler(at)timbira(dot)com>
2008-12-12 18:57:46 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-11 21:33:05 from "Nathan Boley" <npboley(at)gmail(dot)com>
2008-12-11 23:50:19 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-12-11 23:57:47 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 22:04:33 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-11 22:29:38 from Gregory Stark <stark(at)enterprisedb(dot)com>
2008-12-11 22:37:15 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 23:44:04 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-11 23:52:02 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 09:35:49 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 02:23:33 from "Greg Stark" <stark(at)enterprisedb(dot)com>
2008-12-12 09:04:35 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 11:44:21 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-12 14:35:09 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 14:50:41 from "Greg Stark" <stark(at)enterprisedb(dot)com>
2008-12-12 15:08:47 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 15:06:49 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 14:59:35 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 16:10:13 from Gregory Stark <stark(at)enterprisedb(dot)com>
2008-12-12 16:16:16 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 16:43:01 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 18:20:59 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 19:44:16 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 19:59:43 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2009-03-12 01:11:36 from Robert Haas <robertmhaas(at)gmail(dot)com>
2009-03-19 08:04:42 from ITAGAKI Takahiro <itagaki(dot)takahiro(at)oss(dot)ntt(dot)co(dot)jp>
2009-04-03 02:26:46 from Robert Haas <robertmhaas(at)gmail(dot)com>
2008-12-12 16:58:14 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 18:10:00 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 18:22:20 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 17:03:27 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2008-12-12 18:02:34 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 18:07:10 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 18:16:18 from Bruce Momjian <bruce(at)momjian(dot)us>
2008-12-12 16:40:57 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 17:05:58 from Gregory Stark <stark(at)enterprisedb(dot)com>
2008-12-12 17:33:29 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 18:01:40 from "Greg Stark" <stark(at)enterprisedb(dot)com>
2008-12-12 18:18:02 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 19:34:42 from Ron Mayer <rm_pg(at)cheapcomplexdevices(dot)com>
2008-12-12 18:18:49 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 18:31:57 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 18:43:08 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 19:19:16 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-12 19:08:38 from "Greg Stark" <stark(at)enterprisedb(dot)com>
2008-12-12 18:33:12 from "Greg Stark" <stark(at)enterprisedb(dot)com>
2008-12-12 17:09:57 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-11 22:45:47 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 23:17:22 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-11 23:38:15 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 23:35:31 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2008-12-11 23:43:48 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-11 23:47:51 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2008-12-11 22:48:37 from Gregory Stark <stark(at)enterprisedb(dot)com>
2008-12-11 22:56:57 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 01:52:00 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-12 02:12:50 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 03:04:51 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-12 03:12:41 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2008-12-12 12:14:36 from "Robert Haas" <robertmhaas(at)gmail(dot)com>
2008-12-12 14:54:02 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2009-01-02 11:17:29 from Greg Smith <gsmith(at)gregsmith(dot)com>
Lists:
pgsql-hackers
On Thu, 11 Dec 2008, Tom Lane wrote:
> On the whole I think we have some evidence here to say that upping the
> default value of default_stats_target to 100 wouldn't be out of line,
> but 1000 definitely is. Comments?
Circling back to where this started from now that the discussion has
slowed down here, the original tuning suggestions Josh threw out were:
> Mixed:
> default_statistics_target = 100
> DW:
> default_statistics_target = 400
I think this data suggesting serious quadratic behavior doesn't kick in
until much higher than original theorized supports increasing the mixed
number to 100. And if the database default goes to there I think that's
even better. Compared to the current default of 10, that makes for a 4X
increase in planning time for Robert's original test case, and a 5.8X
increase in the more difficult array test Tom came up with.
The only question really open in my mind is whether 400 is still
considered too high for a DW application. Relative to 100, Tom's numbers
suggest that further 4X increase ends up turning into as much as a 8X
increase in planning time. Given the context of a DW application, where
bad plans are really expensive, that suggestion of 400 seems confirmed to
be sane now to me.
--
* Greg Smith gsmith(at)gregsmith(dot)com http://www.gregsmith.com Baltimore, MD
In response to
pgsql-hackers by date
Next :From: Magnus HaganderDate: 2009-01-02 12:21:03
Subject : Overriding Kerberos parameters
Previous :From : Magnus HaganderDate : 2009-01-02 10:13:10
Subject : Re: new libpq SSL connection option