pgsql: Reduce memory usage of targetlist SRFs.

From: Andres Freund <andres(at)anarazel(dot)de>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Reduce memory usage of targetlist SRFs.
Date: 2017-10-08 22:09:48
Message-ID: E1e1Jlc-0002ta-NP@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Reduce memory usage of targetlist SRFs.

Previously nodeProjectSet only released memory once per input tuple,
rather than once per returned tuple. If the computation of an
individual returned tuple requires a lot of memory, that can lead to
problems.

Instead change things so that the expression context can be reset once
per output tuple, which requires a new memory context to store SRF
arguments in.

This is a longstanding issue, but was hard to fix before 9.6, due to
the way tSRFs where evaluated. But it's fairly easy to fix now. We
could backpatch this into 10, but given there've been fewc omplaints
that doesn't seem worth the risk so far.

Reported-By: Lucas Fairchild
Author: Andres Freund, per discussion with Tom Lane
Discussion: https://postgr.es/m/4514.1507318623@sss.pgh.pa.us

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/84ad4b036d975ad1be0f52251bac3a06463c9811

Modified Files
--------------
src/backend/executor/execSRF.c | 31 ++++++++++++++++++++++++++++---
src/backend/executor/nodeProjectSet.c | 32 +++++++++++++++++++++++++++-----
src/include/executor/executor.h | 1 +
src/include/nodes/execnodes.h | 1 +
4 files changed, 57 insertions(+), 8 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Wood, Dan 2017-10-09 06:11:16 Re: [COMMITTERS] pgsql: Fix freezing of a dead HOT-updated tuple
Previous Message Tom Lane 2017-10-08 19:25:45 pgsql: Increase distance between flush requests during bulk file copies