Re: COPY: row is too big

From: Rob Sargent <robjsargent(at)gmail(dot)com>
To: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
Cc: vod vos <vodvos(at)zoho(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: COPY: row is too big
Date: 2017-01-02 20:57:08
Message-ID: F8E3E1D0-B51E-42A5-932B-4A110C2DD5E9@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

> On Jan 2, 2017, at 10:13 AM, Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com> wrote:
>
>> On 01/02/2017 09:03 AM, vod vos wrote:
>> You know, the csv file was exported from other database of a machine, so
>> I really dont want to break it for it is a hard work. Every csv file
>> contains headers and values. If I redesign the table, then I have to cut
>> all the csv files into pieces one by one.
>
> If it helps:
>
> http://csvkit.readthedocs.io/en/latest/tutorial/1_getting_started.html#csvcut-data-scalpel
>>
>>
>> ---- On 星期一, 02 一月 2017 08:21:29 -0800 *Tom Lane
>> <tgl(at)sss(dot)pgh(dot)pa(dot)us>* wrote ----
>>
>> vod vos <vodvos(at)zoho(dot)com <mailto:vodvos(at)zoho(dot)com>> writes:
>>> When I copy data from csv file, a very long values for many
>> columns (about 1100 columns). The errors appears:
>>> ERROR: row is too big: size 11808, maximum size 8160
>>
>> You need to rethink your table schema so you have fewer columns.
>> Perhaps you can combine some of them into arrays, for example.
>> JSON might be a useful option, too.
>>
>> regards, tom lane
>>
>>
>> --
>> Sent via pgsql-general mailing list (pgsql-general(at)postgresql(dot)org
>> <mailto:pgsql-general(at)postgresql(dot)org>)
>> To make changes to your subscription:
>> http://www.postgresql.org/mailpref/pgsql-general
>>
>>
>
>
> --
> Adrian Klaver
> adrian(dot)klaver(at)aklaver(dot)com
>
>
> --
> Sent via pgsql-general mailing list (pgsql-general(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general
Perhaps this is your opportunity to correct someone else's mistake. You need to show the table definition to convince us that it cannot be improved. That it may be hard work really doesn't mean it's not the right path.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Job 2017-01-02 22:54:12 R: Queries on very big table
Previous Message Adrian Klaver 2017-01-02 17:13:45 Re: COPY: row is too big