Re: AXLE Plans for 9.5 and 9.6

From: Jov <amutu(at)amutu(dot)com>
To: Simon Riggs <simon(at)2ndquadrant(dot)com>
Cc: PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: AXLE Plans for 9.5 and 9.6
Date: 2014-04-22 09:42:37
Message-ID: CADyrUxMM3qhMgOzA3m1Y8T-fg4OCNGHG1hJd1KyH+y4XN8kPCw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

what about runtime code generation using LLVM?
http://blog.cloudera.com/blog/2013/02/inside-cloudera-impala-runtime-code-generation/
http://llvm.org/devmtg/2013-11/slides/Wanderman-Milne-Cloudera.pdf

Jov
blog: http:amutu.com/blog <http://amutu.com/blog>

2014-04-22 6:41 GMT+08:00 Simon Riggs <simon(at)2ndquadrant(dot)com>:

> I've discussed 2ndQuadrant's involvement in the AXLE project a few
> times publicly, but never on this mailing list. The project relates to
> innovation and improvement in Business Intelligence for systems based
> upon PostgreSQL in the range of 10-100TB.
>
> Our work will span the 9.5 and 9.6 cycles. We're looking to make
> measurable improvements in a number of cases; one of those is TPC-H,
> since its a publicly accessible benchmark, another is a more private
> benchmark on healthcare data. In brief, this means speeding up the
> performance of large queries, data loading and looking at very large
> systems issues.
>
> Some of areas of R&D are definitely on the roadmap, others are more
> flexible. Some of this is in progress, other stuff is not even at the
> design stage - yet, just a few paragraphs along the lines of "we will
> look at these topics". If we have room, its possible we may
> accommodate other topics; this is not carte blanche, but the reason
> for posting here is so people know we will take input, following the
> normal community process. Detailed in-person discussions at PGCon are
> expected and the Wiki pages will be updated for each aspect.
>
> BI-related Indexing
> * MinMax indexes
> * Bitmap indexes
>
> Large Systems
> * Freeze avoidance
> * Storage management issues for very large systems
>
> Storage Efficiency
> * Compression
> * Column Orientation
>
> Optimisation
> * Bulk loading speed improvements
> * Bulk FK evaluation
> * Executor tuning for very large queries
>
> Query tuning
> * Approximate queries, sampling
> * Materialized Views
>
> ...and possibly some other aspects.
>
> 2ndQuadrant is also assisting other researchers on GPU and FPGA
> topics, which may also yield work of interest to PostgreSQL project.
>
> Couple of points: The project is time limited, so if work gets pushed
> back beyond that then we'll lose the opportunity to contribute. Please
> support our work with timely objections, assistance in defining the
> path forwards and limiting the scope to something that avoids wasting
> this opportunity. Further funding is possible if we don't squander
> this. We are being funded to make best efforts to contribute to open
> source PostgreSQL, not pay-for-commit.
>
> AXLE is funded by the EU under FP7 Grant Agreement 318633. Further
> details are available here http://www.axleproject.eu/
>
> (There are also other 2ndQuadrant development projects in progress,
> this is just one of the larger ones).
>
> Best Regards
>
> --
> Simon Riggs http://www.2ndQuadrant.com/
> PostgreSQL Development, 24x7 Support, Training & Services
>
>
> --
> Sent via pgsql-hackers mailing list (pgsql-hackers(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-hackers
>

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Florian Weimer 2014-04-22 11:19:02 Re: RFC: Async query processing
Previous Message Etsuro Fujita 2014-04-22 09:30:45 Re: A question about code in DefineRelation()