pgsql: Skip text->binary conversion of unnecessary columns in contrib/f

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Skip text->binary conversion of unnecessary columns in contrib/f
Date: 2012-07-12 20:27:48
Message-ID: E1SpPzI-00035Z-Qs@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Skip text->binary conversion of unnecessary columns in contrib/file_fdw.

When reading from a text- or CSV-format file in file_fdw, the datatype
input routines can consume a significant fraction of the runtime.
Often, the query does not need all the columns, so we can get a useful
speed boost by skipping I/O conversion for unnecessary columns.

To support this, add a "convert_selectively" option to the core COPY code.
This is undocumented and not accessible from SQL (for now, anyway).

Etsuro Fujita, reviewed by KaiGai Kohei

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/a36088bcfae85eeeb55e85c3f06c61cb2f0621c6

Modified Files
--------------
contrib/file_fdw/file_fdw.c | 147 ++++++++++++++++++++++++++++++++++++++++++-
src/backend/commands/copy.c | 53 +++++++++++++++
2 files changed, 197 insertions(+), 3 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Peter Eisentraut 2012-07-12 20:53:12 pgsql: Avoid extra newlines in XML mapping in table forest mode
Previous Message Bruce Momjian 2012-07-12 18:37:50 pgsql: Remove 'x =- 1' check for pgindent, not needed, per report from