Re: COPY enhancements

From: Emmanuel Cecchet <manu(at)asterdata(dot)com>
To: Robert Haas <robertmhaas(at)gmail(dot)com>
Cc: Emmanuel Cecchet <Emmanuel(dot)Cecchet(at)asterdata(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: COPY enhancements
Date: 2009-09-25 14:01:27
Message-ID: 4ABCCD37.4000304@asterdata.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Robert,

Here is the new version of the patch that applies to CVS HEAD as of this
morning.

Emmanuel

> On Fri, Sep 18, 2009 at 12:14 AM, Emmanuel Cecchet <manu(at)asterdata(dot)com> wrote:
>
>> Here is a new version of error logging and autopartitioning in COPY based on
>> the latest COPY patch that provides the new syntax for copy options (this
>> patch also includes the COPY option patch).
>>
>> New features compared to previous version:
>> - removed the GUC variables for error logging and use copy options instead
>> (renamed options as suggested by Josh)
>> - added documentation and examples (see copy.sgml)
>> - partitioning also activated by copy option rather than GUC variable
>> (renamed as well)
>> - added a new ERROR_LOGGING_MAX_ERRORS option that allows to abort the COPY
>> operation if a certain number of bad rows has been encountered.
>> - updated unit tests
>>
>> I also tried to update the wiki pages but it's late and the doc is probably
>> better for now.
>>
>> This addresses most of the comments so far except for the format of the
>> error table (lack of natural key) and a possible pg_error_table as a default
>> name.
>>
>> Emmanuel
>>
>> Emmanuel Cecchet wrote:
>>
>>> Hi all,
>>>
>>> Finally the error logging and autopartitioning patches for COPY that I
>>> presented at PGCon are here!
>>> Error logging is described here:
>>> http://wiki.postgresql.org/wiki/Error_logging_in_COPY
>>> Autopartitioning is described here:
>>> http://wiki.postgresql.org/wiki/Auto-partitioning_in_COPY
>>>
>>> The attached patch contains both contribs as well as unit tests. I will
>>> submit shortly the new patch at commitfest.postgresql.org.
>>>
>>> Thanks in advance for your feedback,
>>> Emmanuel
>>>
>
> This no longer applies.
>
> ...Robert
>

--
Emmanuel Cecchet
Aster Data Systems
Web: http://www.asterdata.com

Attachment Content-Type Size
aster-copy-newsyntax-patch-8.5v5context.txt.gz application/x-gzip 35.0 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Eisentraut 2009-09-25 15:28:24 Re: Docs build error in alpha1
Previous Message Pierre Frédéric Caillaud 2009-09-25 13:58:36 Re: Bulk Inserts and WAL Inserts