pgsql: Fix COPY FROM for null marker strings that correspond to invalid

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Fix COPY FROM for null marker strings that correspond to invalid
Date: 2012-03-26 03:18:08
Message-ID: E1SC0Rc-00026k-Vz@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Fix COPY FROM for null marker strings that correspond to invalid encoding.

The COPY documentation says "COPY FROM matches the input against the null
string before removing backslashes". It is therefore reasonable to presume
that null markers like E'\\0' will work ... and they did, until someone put
the tests in the wrong order during microoptimization-driven rewrites.
Since then, we've been failing if the null marker is something that would
de-escape to an invalidly-encoded string. Since null markers generally
need to be something that can't appear in the data, this represents a
nontrivial loss of functionality; surprising nobody noticed it earlier.

Per report from Jeff Davis. Backpatch to 8.4 where this got broken.

Branch
------
REL9_0_STABLE

Details
-------
http://git.postgresql.org/pg/commitdiff/70e94d2dd7ccfa38b13e8d9f6e58db913fe3ec17

Modified Files
--------------
src/backend/commands/copy.c | 45 ++++++++++++++++++++++------------
src/test/regress/expected/copy2.out | 16 ++++++++++++
src/test/regress/sql/copy2.sql | 15 +++++++++++
3 files changed, 60 insertions(+), 16 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Tom Lane 2012-03-26 03:18:09 pgsql: Fix COPY FROM for null marker strings that correspond to invalid
Previous Message Tom Lane 2012-03-26 01:47:30 pgsql: Replace empty locale name with implied value in CREATE DATABASE