Re: START/END line number for COPY FROM

From: Peter Eisentraut <peter(dot)eisentraut(at)2ndquadrant(dot)com>
To: Surafel Temesgen <surafel3000(at)gmail(dot)com>, David Rowley <david(dot)rowley(at)2ndquadrant(dot)com>
Cc: PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: START/END line number for COPY FROM
Date: 2019-01-07 12:59:58
Message-ID: 0d61a3fe-abaf-edd4-60b5-ca54b1678105@2ndquadrant.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 06/01/2019 12:59, Surafel Temesgen wrote:
> it is not always the case to have in control of the data importing it
> may came from
> external system

But the problem that David described remains: If your data loading
requirement is so complicated that you need to load the file in chunks,
then doing it by line numbers will require you to skip over the leading
lines at every subsequent chunk. That's not going to be good for larger
files.

I think your problem needs a different solution.

--
Peter Eisentraut http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Adrien NAYRAT 2019-01-07 13:43:07 Re: [Proposal] Add accumulated statistics
Previous Message Peter Eisentraut 2019-01-07 12:48:40 Re: Using logical replication with older version subscribers