Re: [HACKERS] A Better External Sort?

From: "Dann Corbit" <DCorbit(at)connx(dot)com>
To: "Gregory Maxwell" <gmaxwell(at)gmail(dot)com>, "Ron Peacetree" <rjpeace(at)earthlink(dot)net>
Cc: "Jeffrey W(dot) Baker" <jwbaker(at)acm(dot)org>, <pgsql-hackers(at)postgresql(dot)org>, <pgsql-performance(at)postgresql(dot)org>
Subject: Re: [HACKERS] A Better External Sort?
Date: 2005-10-01 05:32:15
Message-ID: D425483C2C5C9F49B5B7A41F8944154757D147@postal.corporate.connx.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

Judy definitely rates a WOW!!

> -----Original Message-----
> From: pgsql-hackers-owner(at)postgresql(dot)org [mailto:pgsql-hackers-
> owner(at)postgresql(dot)org] On Behalf Of Gregory Maxwell
> Sent: Friday, September 30, 2005 7:07 PM
> To: Ron Peacetree
> Cc: Jeffrey W. Baker; pgsql-hackers(at)postgresql(dot)org; pgsql-
> performance(at)postgresql(dot)org
> Subject: Re: [HACKERS] [PERFORM] A Better External Sort?
>
> On 9/28/05, Ron Peacetree <rjpeace(at)earthlink(dot)net> wrote:
> > 2= We use my method to sort two different tables. We now have these
> > very efficient representations of a specific ordering on these
tables.
> A
> > join operation can now be done using these Btrees rather than the
> > original data tables that involves less overhead than many current
> > methods.
>
> If we want to make joins very fast we should implement them using RD
> trees. For the example cases where a join against a very large table
> will produce a much smaller output, a RD tree will provide pretty much
> the optimal behavior at a very low memory cost.
>
> On the subject of high speed tree code for in-core applications, you
> should check out http://judy.sourceforge.net/ . The performance
> (insert, remove, lookup, AND storage) is really quite impressive.
> Producing cache friendly code is harder than one might expect, and it
> appears the judy library has already done a lot of the hard work.
> Though it is *L*GPLed, so perhaps that might scare some here away from
> it. :) and good luck directly doing joins with a LC-TRIE. ;)
>
> ---------------------------(end of
broadcast)---------------------------
> TIP 6: explain analyze is your friend

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2005-10-01 06:01:58 Re: [HACKERS] A Better External Sort?
Previous Message Michael Fuhr 2005-10-01 05:23:19 Re: Expression index ignores column statistics target

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2005-10-01 06:01:58 Re: [HACKERS] A Better External Sort?
Previous Message Gregory Maxwell 2005-10-01 02:07:16 Re: [PERFORM] A Better External Sort?