Re: Catching exceptions from COPY

From: Greg Smith <gsmith(at)gregsmith(dot)com>
To: Darren Reed <darrenr+postgres(at)fastmail(dot)net>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: Catching exceptions from COPY
Date: 2008-05-29 01:12:40
Message-ID: Pine.GSO.4.64.0805282107090.1115@westnet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, 28 May 2008, Darren Reed wrote:

> Is it feasible to add the ability to catch exceptions from COPY?

Depends on what you consider feasible. There's a start to a plan for that
on the TODO list: http://www.postgresql.org/docs/faqs.TODO.html but it's
not trivial to implement.

It's also possible to do this right now using pgloader:
http://pgfoundry.org/projects/pgloader/ That requires some setup and
there's overhead to passing through that loading layer.

A third possibility is to write a short script specifically aimed at your
copy need that breaks your input files into smaller chunks and loads them,
kicking back the ones that don't load, or breaking them into even smaller
chunks until you've found the problem line or lines.

--
* Greg Smith gsmith(at)gregsmith(dot)com http://www.gregsmith.com Baltimore, MD

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Mike 2008-05-29 01:47:22 Re: intercepting WAL writes
Previous Message Thomas H. 2008-05-29 01:05:23 Re: BUG #4186: set lc_messages does not work