Skip site navigation (1) Skip section navigation (2)

Inserting 'large' amounts of data

From: Mario Splivalo <mario(dot)splivalo(at)megafon(dot)hr>
To: pgsql-jdbc(at)postgresql(dot)org
Subject: Inserting 'large' amounts of data
Date: 2009-08-26 16:28:44
Message-ID: (view raw, whole thread or download thread mbox)
Lists: pgsql-jdbc
I have a web application which allows users to upload a lot of phone
numbers. I need to store those numbers to a database. Usualy, one would
upload around 70k-100k of records, totaling around 2 MB in size.

I'm using tomcat as an application server, and JDBC to connect to pg8.3

I will have around 20-50 concurent users in peek hours, and even that is
quite overestimated.

I could create the temporary file on the filesystem where database
cluster is located and then execute COPY mytable FROM
'/tmp/upload-data/uuidofsomesort.csv' WITH CSV', but the 'problem' is
that database server and tomcat reside on different physical machines.

What would one recommend as the best way to insert those data?



pgsql-jdbc by date

Next:From: John R PierceDate: 2009-08-26 17:17:11
Subject: Re: Inserting 'large' amounts of data
Previous:From: Maciek SakrejdaDate: 2009-08-26 09:01:51
Subject: Re: PGStream synchronization

Privacy Policy | About PostgreSQL
Copyright © 1996-2017 The PostgreSQL Global Development Group