Re: 512,600ms query becomes 7500ms... but why? Postgres 8.3 query planner quirk?

From: Karl Denninger <karl(at)denninger(dot)net>
To: Kevin Grittner <Kevin(dot)Grittner(at)wicourts(dot)gov>
Cc: Bryce Nesbitt <bryce2(at)obviously(dot)com>, pgsql-performance(at)postgresql(dot)org
Subject: Re: 512,600ms query becomes 7500ms... but why? Postgres 8.3 query planner quirk?
Date: 2010-02-12 16:05:45
Message-ID: 4B757C59.8070500@denninger.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

"Exists" can be quite slow. So can "not exists"

See if you can re-write it using a sub-select - just replace the "exists
...." with "(select ...) is not null"

Surprisingly this often results in a MUCH better query plan under
Postgresql. Why the planner evaluates it "better" eludes me (it
shouldn't) but the differences are often STRIKING - I've seen
factor-of-10 differences in execution performance.

Kevin Grittner wrote:
> Bryce Nesbitt <bryce2(at)obviously(dot)com> wrote:
>
>
>> I've got a very slow query, which I can make faster by doing
>> something seemingly trivial.
>>
>
> Out of curiosity, what kind of performance do you get with?:
>
> EXPLAIN ANALYZE
> SELECT contexts.context_key
> FROM contexts
> JOIN articles ON (articles.context_key = contexts.context_key)
> JOIN matview_82034 ON (matview_82034.context_key =
> contexts.context_key)
> WHERE EXISTS
> (
> SELECT *
> FROM article_words
> JOIN words using (word_key)
> WHERE context_key = contexts.context_key
> AND word = 'insider'
> )
> AND EXISTS
> (
> SELECT *
> FROM article_words
> JOIN words using (word_key)
> WHERE context_key = contexts.context_key
> AND word = 'trading'
> )
> AND EXISTS
> (
> SELECT *
> FROM virtual_ancestors a
> JOIN bp_categories ON (bp_categories.context_key =
> a.ancestor_key)
> WHERE a.context_key = contexts.context_key
> AND lower(bp_categories.category) = 'law'
> )
> AND articles.indexed
> ;
>
> (You may have to add some table aliases in the subqueries.)
>
> If you are able to make a copy on 8.4 and test the various forms,
> that would also be interesting. I suspect that the above might do
> pretty well in 8.4.
>
> -Kevin
>
>

Attachment Content-Type Size
karl.vcf text/x-vcard 124 bytes

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Kevin Grittner 2010-02-12 16:11:00 Re: 512,600ms query becomes 7500ms... but why? Postgres 8.3 query planner quirk?
Previous Message Connors, Bill 2010-02-12 16:03:05 Questions on plan with INSERT/SELECT on partitioned table