Skip site navigation (1) Skip section navigation (2)

Re: Data Warehouse Reevaluation - MySQL vs Postgres --

From: "Leeuw van der, Tim" <tim(dot)leeuwvander(at)nl(dot)unisys(dot)com>
To: "Markus Schaber" <schabios(at)logi-track(dot)com>,"PostgreSQL Performance List" <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Data Warehouse Reevaluation - MySQL vs Postgres --
Date: 2004-09-14 12:42:20
Message-ID: BF88DF69D9E2884B9BE5160DB2B97A85010D6D5F@nlshl-exch1.eu.uis.unisys.com (view raw or flat)
Thread:
Lists: pgsql-performance
Hi,

I found bulk-insert to perform very slow, when compared to MySQL / Oracle. All inserts were done in 1 transaction. However, mitigating factors here were:
- Application was a .Net application using ODBC drivers
- PostgreSQL 7.3 running on CYGWIN with cygipc daemon
- Probably very bad tuning in the config file, if any tuning done at all
- The application was issuing 'generic' SQL since it was generally used with Oracle and MySQL databases. So no tricks like using COPY or multiple rows with 1 INSERT statement. No stored procedures either.
- When doing queries, most of the time the results were comparable to or better than MySQL (the only other database that I tested with myself).


So what I can say is, that if you want fast INSERT performance from PostgreSQL then you'll probably have to do some trickery that you wouldn't have to do with a default MySQL installation.

regards,

--Tim


-----Original Message-----
From: pgsql-performance-owner(at)postgresql(dot)org [mailto:pgsql-performance-owner(at)postgresql(dot)org]On Behalf Of Markus Schaber
Sent: Tuesday, September 14, 2004 2:15 PM
To: PostgreSQL Performance List
Subject: Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres --


Hi, Mischa,

On Sun, 12 Sep 2004 20:47:17 GMT
Mischa Sandberg <ischamay(dot)andbergsay(at)activestateway(dot)com> wrote:

> On the other hand, if you do warehouse-style loading (Insert, or PG 
> COPY, into a temp table; and then 'upsert' into the perm table), I can 
> guarantee 2500 inserts/sec is no problem.

As we can forsee that we'll have similar insert rates to cope with in
the not-so-far future, what do you mean with 'upsert'? Do you mean a
stored procedure that iterates over the temp table?

Generally, what is the fastest way for doing bulk processing of 
update-if-primary-key-matches-and-insert-otherwise operations?

Thanks,
Markus Schaber

-- 
markus schaber | dipl. informatiker
logi-track ag | rennweg 14-16 | ch 8001 z├╝rich
phone +41-43-888 62 52 | fax +41-43-888 62 53
mailto:schabios(at)logi-track(dot)com | www.logi-track.com

---------------------------(end of broadcast)---------------------------
TIP 4: Don't 'kill -9' the postmaster

Responses

pgsql-performance by date

Next:From: Aaron WermanDate: 2004-09-14 13:24:35
Subject: Re: Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables
Previous:From: Markus SchaberDate: 2004-09-14 12:14:52
Subject: Re: Data Warehouse Reevaluation - MySQL vs Postgres --

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group