| From: | Adam Lee <ali(at)pivotal(dot)io> |
|---|---|
| To: | Jeff Davis <pgsql(at)j-davis(dot)com> |
| Cc: | Peter Geoghegan <pg(at)bowt(dot)ie>, Heikki Linnakangas <hlinnaka(at)iki(dot)fi>, Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, Taylor Vesely <tvesely(at)pivotal(dot)io>, Melanie Plageman <mplageman(at)pivotal(dot)io>, PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: Memory-Bounded Hash Aggregation |
| Date: | 2020-02-04 10:42:29 |
| Message-ID: | 20200204104229.GA58298@earth.local |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
On Mon, Feb 03, 2020 at 06:24:14PM -0800, Jeff Davis wrote:
> On Mon, 2020-02-03 at 10:29 -0800, Jeff Davis wrote:
> > I ended up converting the freelist to a min heap.
> >
> > Attached is a patch which makes three changes to better support
> > HashAgg:
>
> And now I'm attaching another version of the main Hash Aggregation
> patch to be applied on top of the logtape.c patch.
>
> Not a lot of changes from the last version; mostly some cleanup and
> rebasing. But it's faster now with the logtape.c changes.
Nice!
Just back from the holiday. I had the perf test with Tomas's script,
didn't notice the freelist sorting regression at that time.
The minheap looks good, have you tested the performance and aggregate
validation?
About the "Cap the size of the LogicalTapeSet's freelist" and "Don't
bother tracking free space for HashAgg at all" you mentioned in last
mail, I suppose these two options will lost the disk space saving
benefit since some blocks are not reusable then?
--
Adam Lee
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Thomas Munro | 2020-02-04 10:44:48 | More DSM slot exhaustion bugs |
| Previous Message | k.jamison@fujitsu.com | 2020-02-04 09:57:26 | RE: [Patch] Optimize dropping of relation buffers using dlist |