On 02/02/11 10:20 AM, Nicolas Grilly wrote:
> Is the copy protocol (aka PQputCopyData and PQputCopyEnd) designed to 
> send gigabytes of data with just one "copy ... from stdio" query, and 
> is there a way to be notified of a potential error before calling 
> PQputCopyEnd? Or do I have to send my data in small chunks (for 
> example batch of 10000 rows), issue a PQputCopyEnd, check for errors, 
> and continue with the next chunk?

I would batch the data, maybe 1000 lines or even 100 lines at a time if 
these errors are at all frequent.  put the errored batches in an 
exception list or something so you can sort them out later.

In response to

• Why "copy ... from stdio" does not return immediately when reading invalid data? at 2011-02-02 18:20:15 from Nicolas Grilly

Responses

• Re: Why "copy ... from stdio" does not return immediately when reading invalid data? at 2011-02-07 14:55:24 from Nicolas Grilly

pgsql-hackers by date

Next:	From: vaibhavkaushal123	Date: 2011-02-02 19:25:12
	Subject: Elephants
Previous:	From: Greg Smith	Date: 2011-02-02 18:47:21
	Subject: Re: [HACKERS] Slow count(*) again...

pgsql-general by date

Next:	From: William Bruton	Date: 2011-02-02 19:08:19
	Subject: upgrade
Previous:	From: Carlos Mennens	Date: 2011-02-02 18:32:41
	Subject: Database Design Question