Re: GSoC on WAL-logging hash indexes

From: Greg Stark <stark(at)mit(dot)edu>
To: Robert Haas <robertmhaas(at)gmail(dot)com>
Cc: Jeff Janes <jeff(dot)janes(at)gmail(dot)com>, Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>, Tan Tran <tankimtran(at)gmail(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: GSoC on WAL-logging hash indexes
Date: 2014-03-07 00:07:41
Message-ID: CAM-w4HMLcseCeNGimgoJz1EziHpztMuEZdzgCeFOUsQDhBV26w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-advocacy pgsql-hackers pgsql-students

On Thu, Mar 6, 2014 at 11:14 PM, Robert Haas <robertmhaas(at)gmail(dot)com> wrote:
>> I've been tempted to implement a new type of hash index that allows both WAL
>> and high concurrency, simply by disallowing bucket splits. At the index
>> creation time you use a storage parameter to specify the number of buckets,
>> and that is that. If you mis-planned, build a new index with more buckets,
>> possibly concurrently, and drop the too-small one.
>
> Yeah, we could certainly do something like that. It sort of sucks,
> though. I mean, it's probably pretty easy to know that starting with
> the default 2 buckets is not going to be enough; most people will at
> least be smart enough to start with, say, 1024. But are you going to
> know whether you need 32768 or 1048576 or 33554432? A lot of people
> won't, and we have more than enough reasons for performance to degrade
> over time as it is.

The other thought I had was that you can do things lazily in vacuum.
So when you probe you need to check multiple pages until vacuum comes
along and rehashes everything.

--
greg

In response to

Responses

Browse pgsql-advocacy by date

  From Date Subject
Next Message Heikki Linnakangas 2014-03-07 09:34:39 Re: GSoC on WAL-logging hash indexes
Previous Message Robert Haas 2014-03-06 23:14:21 Re: GSoC on WAL-logging hash indexes

Browse pgsql-hackers by date

  From Date Subject
Next Message Josh Berkus 2014-03-07 01:20:01 Re: jsonb and nested hstore
Previous Message Simon Riggs 2014-03-06 23:49:16 Re: ALTER TABLE lock strength reduction patch is unsafe Reply-To:

Browse pgsql-students by date

  From Date Subject
Next Message Heikki Linnakangas 2014-03-07 09:34:39 Re: GSoC on WAL-logging hash indexes
Previous Message Robert Haas 2014-03-06 23:14:21 Re: GSoC on WAL-logging hash indexes