Add column-name hint to log messages generated by inserts when varchars don't fit

From: "Stepan Rutz" <Stepan(dot)Rutz(at)gmx(dot)de>
To: pgsql-hackers(at)postgresql(dot)org
Subject: Add column-name hint to log messages generated by inserts when varchars don't fit
Date: 2015-08-05 10:39:26
Message-ID: trinity-53b335a3-11e3-43df-b820-e28935108e6b-1438771166514@3capp-gmx-bs49
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi everybody again,

(Resending this EMail again because apparently I have just send in HTML format, which wasn't my intention)

on our production servers I have quite some errors due to excessively long varchar-values which application-code tries to insert into tables and which don't fit.
The errors look like

ERROR: value too long for type character varying(4)

This is not helping me much. The patch will turn this too

ERROR: value too long for type character varying(4) (hint: column-name is mycolumn)

if the column that was overflown was mycolumn.

The tables have many columns, the statements are not readable and many columns happen to have the same length. Powers of 2 most often for some odd reason ...
I fired up gdb and saw that the error message is generated during the preprocessing of the query where some kind of the constant-folding/constant-elimination happens on the parse-tree. I went ahead and added a try/catch at some point upwards in the call-stack where at least i have the contact of the T_TargetEntry. That has a field resname which gives me exactly the information i need... The column which was overflown. With that info i can fix the application code much more easily. Relation name was out of reach for me, there is a void* passed transparently to the constant-mutator but that is not checkable at the point. That context contains the original top-level statement node however.
The patch just adds a bit of hinting to the error message and goes on.. That is all but really helpful to me and potentially also others.
Attached Patch has more Infos and comments.
Regards from Germany,
Stepan

Stepan Rutz
Phone: +49 (0) 178 654 9284
Email: stepan(dot)rutz(at)gmx(dot)de
Earth: Brunnenallee 25a, 50226 Frechen, Germany

Attachment Content-Type Size
columname_hint.patch application/octet-stream 4.1 KB

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Nikolay Shaplov 2015-08-05 10:52:27 Re: pageinspect patch, for showing tuple data
Previous Message Stepan Rutz 2015-08-05 10:24:08 Add column-name hint to log messages generated by inserts when varchars don't fit