Skip site navigation (1) Skip section navigation (2)

Re: updated hash functions for postgresql v1

From: "Luke Lonergan" <LLonergan(at)greenplum(dot)com>
To: "Simon Riggs" <simon(at)2ndquadrant(dot)com>,"CK(dot)Tan" <cktan(at)greenplum(dot)com>
Cc: "Kenneth Marshall" <ktm(at)rice(dot)edu>,pgsql-patches(at)postgresql(dot)org,twraney(at)comcast(dot)net,neilc(at)samurai(dot)com
Subject: Re: updated hash functions for postgresql v1
Date: 2007-10-28 21:27:42
Message-ID: C3E62232E3BCF24CBA20D72BFDCB6BF8044A24AF@MI8NYCMAIL08.Mi8.com (view raw or flat)
Thread:
Lists: pgsql-patches
That's on Greenplum latest.

We used this query to expose CPU heavy aggregation.

The 1GB overall TPCH size is chosen to fit into the RAM of a typical workstation/laptop with 2GB of RAM.  That ensures the time is spent in the CPU processing of the hashagg, which is what we'd like to measure here.

The PG performance will be different, but the measurement approach should be the same IMO.  The only suggestion to make it easier is to use 250MB scale factor, as we use four cores against 1GB.  The principal is the same.

- Luke

Msg is shrt cuz m on ma treo

 -----Original Message-----
From: 	Simon Riggs [mailto:simon(at)2ndquadrant(dot)com]
Sent:	Sunday, October 28, 2007 04:48 PM Eastern Standard Time
To:	CK.Tan
Cc:	Luke Lonergan; Kenneth Marshall; pgsql-patches(at)postgresql(dot)org; twraney(at)comcast(dot)net; neilc(at)samurai(dot)com
Subject:	Re: [PATCHES] updated hash functions for postgresql v1

On Sun, 2007-10-28 at 13:19 -0700, CK Tan wrote:
> Hi, this query on TPCH 1G data gets about 5% improvement.

> select count (*) from (select l_orderkey, l_partkey, l_comment,
> count(l_tax) from lineitem group by 1, 2, 3) tmpt;

> On Oct 28, 2007, at 1:17 PM, Luke Lonergan wrote:
> 
> > We just applied this and saw a 5 percent speedup on a hash
> > aggregation query with four colums in a 'group by' clause run
> > against a single TPC-H table (lineitem).
> > 
> > CK - can you post the query? 

Is this on Postgres or Greenplum?


That looks like quite a wide set of columns.

Sounds good though. Can we get any more measurements in?

-- 
  Simon Riggs
  2ndQuadrant  http://www.2ndQuadrant.com

pgsql-patches by date

Next:From: Kenneth MarshallDate: 2007-10-29 03:36:26
Subject: Re: updated hash functions for postgresql v1
Previous:From: Simon RiggsDate: 2007-10-28 20:45:21
Subject: Re: updated hash functions for postgresql v1

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group