Re: Maximum insert per second

From: Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
To: lst_hoe02(at)kwsoft(dot)de
Cc: pgsql-admin(at)postgresql(dot)org
Subject: Re: Maximum insert per second
Date: 2011-07-15 09:39:46
Message-ID: CAOR=d=2m_nKyzn8_S1iX7UnMgyCUGkS6a2XHPmVpbTPdZa96+A@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

On Fri, Jul 15, 2011 at 2:09 AM, <lst_hoe02(at)kwsoft(dot)de> wrote:
> Zitat von Kevin Grittner <Kevin(dot)Grittner(at)wicourts(dot)gov>:
>
>> Jenish Vyas <jenishvyas(at)gmail(dot)com> wrote:
>>
>>> I am able to insert 1190- 1210 records per seconds.
>>>
>>> Now I just want to know by what extend I could stretch it.
>>>
>>> What is the maximum insert I can achieve in one second?  What is
>>> the maximum number of insert postgresql achieved so far?
>>
>> I don't have hard numbers handy, and I know I don't have the fastest
>> hardware out there, but for bulk loads of narrow tables we typically
>> see tens of thousands of rows per second.  Of course that's with
>> "running with scissors" settings.  We turn off archiving,
>> autovacuum, fsync, full_page_writes, and synchronous_commit; and
>> COPY rows within the same transaction which creates the table,
>> before creating any indexes.  Then we build the indexes, VACUUM
>> FREEZE ANALYZE, and change back to a configuration which actually
>> preserves the data on a crash.
>>
>> From memory, I would say on our larger servers we've probably seen
>> a max of something on the order of 50,000 rows per second on
>> relatively narrow tables, without factoring the index build and
>> vacuum times.
>>
>
> Are there any numbers around for OLTP like systems? Would be nice to know
> what is possible with PostgreSQL in this case.

System: SuperMicro H8QG6
4xAMD Opteron(tm) Processor 6168
Total 48 cores
128G RAM
Areca 1680 w 512M battery backed cache
32 15k SAS 147Gig drives

pgbench -i -s 100
pgbench -c 48 -t 10000
tps = 7777.626762 (including connections establishing)
tps = 7808.976047 (excluding connections establishing)

If I run them for much longer, it'll drop down a bit and average about
4 to 5k sustained tps.

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Scott Marlowe 2011-07-15 10:09:23 Re: Maximum insert per second
Previous Message lst_hoe02 2011-07-15 08:09:26 Re: Maximum insert per second