Skip site navigation (1) Skip section navigation (2)

Re: Postgres query completion status?

From: Richard Neill <rn214(at)cam(dot)ac(dot)uk>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Postgres query completion status?
Date: 2009-11-22 15:10:11
Message-ID: (view raw, whole thread or download thread mbox)
Lists: pgsql-performance
Thanks very much for your help so far.
> (it is pretty confusing that the HashAggregate reports ~6M rows, but
> the sort does 41M rows, but maybe I can not read this).
> Anyway, I think that if You up the work_mem for this query to 512M,
> the sort will be in memory, an thus plenty faster.

Tried this (with work_mem 2GB). It seems to make a difference, but not 
enough: the query time is about halved (from 220 sec to 120 sec)

> Also, You say You are experiencing unstable query plans, and this may
> mean that geqo is kicking in (but Your query seems too simple for
> that, even considering the views involved). A quick way to check that
> would be to run explain <the query> a coule tens of times, and check
> if the plans change. If they do, try upping geqo_threshold.

It's not unstable from one run to the next; it's unstable from one day 
to the next (more on this later)

> You have seq_page_cost 4 times larger than random_page_cost. You say
> You are on SSD, so there is no random access penalty. Try setting them
> equal.

Again, experimentally, it seems to be non-equal. I didn't benchmark 
this, but the random access tests done by TomsHardware et al suggest a 
factor 2.5 penalty for random access vs sequential. This is very much 
better than rotational disks, but still significant.

> Your plan is full of merge-joins, some indices may be in order. Merge
> join is a kind of "last-chance" plan.

I think the fix here is going to be to do more work at write-time and 
less at read-time. i.e. rather than having really complex views, we'll 
generate some extra tables, and keep them synchronized with triggers.


In response to

pgsql-performance by date

Next:From: Richard NeillDate: 2009-11-22 15:10:17
Subject: Re: Postgres query completion status?
Previous:From: Jonathan BlitzDate: 2009-11-22 13:34:31
Subject: Re: Why is the query not using the index for sorting?

Privacy Policy | About PostgreSQL
Copyright © 1996-2017 The PostgreSQL Global Development Group