Skip site navigation (1) Skip section navigation (2)

Concurrent COPY commands

From: Phillip Sitbon <phillip(at)sitbon(dot)net>
To: pgsql-novice(at)postgresql(dot)org
Subject: Concurrent COPY commands
Date: 2008-07-02 16:44:21
Message-ID: (view raw, whole thread or download thread mbox)
Lists: pgsql-novice

I am running some queries that use multiple connections to issue COPY 
commands which bring data into the same table via different files (FIFOs 
to be precise). This is being done on a SMP machine and I am noticing 
that none of the postgres worker processes operate in parallel, even 
though there is data available to all of them. The performance is nearly 
exactly the same as it is for issuing a single COPY command. Is this 
normal behavior, even with all of the separate transactions still in 
progress? Would I be better off doing multithreaded bulk inserts from my 
C program rather than sending the data to FIFOs?

The machine I am using has 16GB of memory and 8 cores, so I've tried to 
optimize the configuration accordingly but I am a little lost in some 

Thanks in advance for your advice,



pgsql-novice by date

Next:From: Tom LaneDate: 2008-07-02 16:48:06
Subject: Re: encoding problem when creating a database
Previous:From: DanielDate: 2008-07-02 15:37:28
Subject: Re: Calculating repeating events - functionality lost with the demise of tinterval ?

Privacy Policy | About PostgreSQL
Copyright © 1996-2017 The PostgreSQL Global Development Group