COPY FROM STDIN instead of INSERT

From: "Ilja Golshtein" <ilejn(at)yandex(dot)ru>
To: pgsql-general(at)postgresql(dot)org
Cc: oleg(at)sai(dot)msu(dot)su, teodor(at)sigaev(dot)ru
Subject: COPY FROM STDIN instead of INSERT
Date: 2006-10-18 06:06:31
Message-ID: 4535C467.000001.08425@mfront8.yandex.ru
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hello!

One important use case in my libpq based application (PostgreSQL 8.1.4) is a sort of massive data loading.

Currently it is implemented as a series of plain normal INSERTs
(binary form of PQexecParams is used) and the problem here it is pretty slow.

I've tried to play with batches and with peculiar constructions
like INSERT (SELECT .. UNION ALL SELECT ..) to improve performance, but not satisfied with the result I've got.

Now I try to figure out if it is possible to use COPY FROM STDIN instead of INSERT if I have to insert, say, more then 100 records at once.

Hints are highly appreciated.

The only limitaion mentioned in Manual is about Rules and I don't care about this since I don't use Rules.
Am I going to come across with any other problems (concurrency, reliability, compatibility, whatever) on this way?

Many thanks.

--
Best regards
Ilja Golshtein

Responses

Browse pgsql-general by date

  From Date Subject
Next Message roopa perumalraja 2006-10-18 06:09:44 Re: Maximum size of database
Previous Message louis gonzales 2006-10-18 05:47:54 Re: Is Postgres good for large Applications