Re: Zedstore - compressed in-core columnar storage

From: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>
To: Peter Geoghegan <pg(at)bowt(dot)ie>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, Stephen Frost <sfrost(at)snowman(dot)net>, Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>, Konstantin Knizhnik <k(dot)knizhnik(at)postgrespro(dot)ru>, Ashwin Agrawal <aagrawal(at)pivotal(dot)io>, PostgreSQL mailing lists <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Zedstore - compressed in-core columnar storage
Date: 2019-04-25 06:44:45
Message-ID: c4f3f315-bee3-3d7f-1284-5db2c528fbc6@iki.fi
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 15/04/2019 22:32, Peter Geoghegan wrote:
> On Mon, Apr 15, 2019 at 12:19 PM Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:
>> Perhaps, but we won't know if we don't try. I think we should try,
>> and be willing to add hooks and flexibility to core as needed to make
>> it possible.
>
> We could approach it without taking a firm position on inclusion in
> core until the project begins to mature. I have little faith in our
> ability to predict which approach will be the least painful at this
> early stage.

When we started hacking on this, we went in with the assumption that
this would have to be in core, because WAL-logging, and also because a
column-store will probably need some changes to the planner and executor
to make it shine. And also because a lot of people would like to have a
column store in PostgreSQL (although a "column store" could mean many
different things with different tradeoffs). But if we just have all the
necessary hooks in core, sure, this could be an extension, too.

But as you said, we don't need to decide that yet. Let's wait and see,
as this matures.

- Heikki

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message John Naylor 2019-04-25 07:09:10 Re: Unhappy about API changes in the no-fsm-for-small-rels patch
Previous Message John Naylor 2019-04-25 03:21:21 Re: Unhappy about API changes in the no-fsm-for-small-rels patch