pgloader 2.3.1 with fixed format support

From: Dimitri Fontaine <dfontaine(at)hi-media(dot)com>
To: pgsql-announce(at)postgresql(dot)org
Subject: pgloader 2.3.1 with fixed format support
Date: 2008-06-03 12:42:44
Message-ID: 200806031442.47308.dfontaine@hi-media.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-announce

Hi,

PgLoader is the python ETL tool for PostgreSQL, supporting a lot of (possibly
convoluted) input formats, and able to load files in parallel. Either loading
several files at once (each in its own PG connection) or the same file in
several connections (two collaborative models implemented).
http://pgloader.projects.postgresql.org/

This new version of pgloader has seen some testing of max_parallel_sections
setting, a user was able to load 1000 files using 10 parallel sections.

Version 2.3.1 also supports fixed file format, where no field separator exists
but each field length is known (and fixed). This premature support does not
offer any facility for stripping (left, right or both), I'll work on this if
there's any demand.

The changelog also misses to specify escape characters are now supported for
configuring field_sep, such as \t for example.

Regards,
--
dim

Browse pgsql-announce by date

  From Date Subject
Next Message Dave Page 2008-06-05 09:38:18 pgAdmin III v1.8.4 released
Previous Message John DeSoi 2008-06-03 00:43:19 pgEdit 1.4 released