Re: [HACKERS] GSoC on WAL-logging hash indexes

From: Robert Haas <robertmhaas(at)gmail(dot)com>
To: Peter Geoghegan <pg(at)heroku(dot)com>
Cc: "ktm(at)rice(dot)edu" <ktm(at)rice(dot)edu>, Tan Tran <tankimtran(at)gmail(dot)com>, Greg Stark <stark(at)mit(dot)edu>, pgsql-advocacy <pgsql-advocacy(at)postgresql(dot)org>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [HACKERS] GSoC on WAL-logging hash indexes
Date: 2014-04-30 17:11:55
Message-ID: CA+TgmoYqx312omye5wVhT_rsy7a6OGUe2YRWUt=b72wrOsou5w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-advocacy pgsql-hackers pgsql-students

On Wed, Apr 30, 2014 at 12:54 PM, Peter Geoghegan <pg(at)heroku(dot)com> wrote:
> On Wed, Apr 30, 2014 at 5:55 AM, ktm(at)rice(dot)edu <ktm(at)rice(dot)edu> wrote:
>> I do not think that CPU costs matter as much as the O(1) probe to
>> get a result value specifically for very large indexes/tables where
>> even caching the upper levels of a B-tree index would kill your
>> working set in memory. I know, I know, everyone has so much memory
>> and can just buy more... but this does matter.
>
> Have you actually investigated how little memory it takes to store the
> inner pages? It's typically less than 1% of the entire index. AFAIK,
> hash indexes are not used much in any other system. I think MySQL has
> them, and SQL Server 2014 has special in-memory hash table indexes for
> in memory tables, but that's all I can find on Google.

I thought the theoretical advantage of hash indexes wasn't that they
were smaller but that you avoided a central contention point (the
btree root).

Of course our current hash indexes have *more* not less contention
than btree but I'm pretty comfortable chalking that up to quality of
implementation rather than anything intrinsic.

--
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

In response to

Responses

Browse pgsql-advocacy by date

  From Date Subject
Next Message Josh Berkus 2014-04-30 17:58:29 Re: GSoC on WAL-logging hash indexes
Previous Message Peter Geoghegan 2014-04-30 16:54:36 Re: [HACKERS] GSoC on WAL-logging hash indexes

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2014-04-30 17:47:57 Re: pg_get_viewdefs() indentation considered harmful
Previous Message Peter Geoghegan 2014-04-30 16:54:36 Re: [HACKERS] GSoC on WAL-logging hash indexes

Browse pgsql-students by date

  From Date Subject
Next Message Josh Berkus 2014-04-30 17:58:29 Re: GSoC on WAL-logging hash indexes
Previous Message Peter Geoghegan 2014-04-30 16:54:36 Re: [HACKERS] GSoC on WAL-logging hash indexes