Re: asynchronous and vectorized execution

From: Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp>
To: amitdkhan(dot)pg(at)gmail(dot)com
Cc: robertmhaas(at)gmail(dot)com, pgsql-hackers(at)postgresql(dot)org
Subject: Re: asynchronous and vectorized execution
Date: 2016-08-29 08:08:36
Message-ID: 20160829.170836.161449399.horiguchi.kyotaro@lab.ntt.co.jp
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hello,

I considered applying the async infrastructure onto nodeGather,
but since parallel workers hardly make Gather (or the leader)
wait, it's really useless at least for simple cases. Furthermore,
as several people may have said before, being defferent from
foreign scans, gather (or other kinds of parallel) nodes usually
have several workers and will have up to two digit nubmers at the
most even on so-called many-core boxes. I finally gave up
applying this to nodeGather.

As the result, the attached patchset is functionally the same
with the last version but replace misused Assert with
AssertMacro.

regards,

--
Kyotaro Horiguchi
NTT Open Source Software Center

Attachment Content-Type Size
0001-Modify-PlanState-to-include-a-pointer-to-the-parent-.patch text/x-patch 21.4 KB
0002-Modify-PlanState-to-have-result-result_ready-fields..patch text/x-patch 67.4 KB
0003-Lightweight-framework-for-waiting-for-events.patch text/x-patch 15.2 KB
0004-Fix-async-execution-framework.patch text/x-patch 19.3 KB
0005-Add-new-fdwroutine-AsyncConfigureWait-and-ShutdownFo.patch text/x-patch 3.6 KB
0006-Make-postgres_fdw-async-capable.patch text/x-patch 40.6 KB
0007-Make-Append-node-async-aware.patch text/x-patch 4.5 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Craig Ringer 2016-08-29 08:28:07 Re: Renaming of pg_xlog and pg_clog
Previous Message Yury Zhuravlev 2016-08-29 08:03:11 Re: Why is a newly created index contains the invalid LSN?