Re: realtime data inserts

From: "Jim C(dot) Nasby" <jim(at)nasby(dot)net>
To: Adam Siegel <adam(at)sycamorehq(dot)com>
Cc: pgsql-hackers(at)postgresql(dot)org, pgsql-performance(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: Re: realtime data inserts
Date: 2003-05-10 17:08:33
Message-ID: 20030510120833.K66185@flake.decibel.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

Are you binding your insert? IE:

prepare statement INSERT INTO blah VALUES (?, ?, ?);

execute statement (a, b, c)

Instead of just "INSERT INTO blah VALUES(a, b, c)"

On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote:
> I have realtime data flowing at a rate of 500, 512 byte packets per second.
> I want to log the info in a database table with two other columns, one for a
> timestamp and one for a name of the packet. The max rate I can achieve is
> 350 inserts per second on a sun blade 2000. The inserts are grouped in a
> transaction and I commit every 1200 records. I am storing the binary data
> in a bytea. I am using the libpq conversion function. Not sure if that is
> slowing me down. But I think it is the insert not the conversion.
>
> Any thoughts on how to achive this goal?

--
Jim C. Nasby (aka Decibel!) jim(at)nasby(dot)net
Member: Triangle Fraternity, Sports Car Club of America
Give your computer some brain candy! www.distributed.net Team #1828

Windows: "Where do you want to go today?"
Linux: "Where do you want to go tomorrow?"
FreeBSD: "Are you guys coming, or what?"

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Jim C. Nasby 2003-05-10 17:19:33 Re: pg_dump && tar && /tmp
Previous Message Ericson Smith 2003-05-10 16:02:18 Re: realtime data inserts

Browse pgsql-hackers by date

  From Date Subject
Next Message Jim C. Nasby 2003-05-10 17:12:23 Re: Plans for index names unique to a table?
Previous Message Tom Lane 2003-05-10 16:10:08 Re: Plans for index names unique to a table?

Browse pgsql-performance by date

  From Date Subject
Next Message Ron Johnson 2003-05-10 18:31:30 Re: realtime data inserts
Previous Message Ericson Smith 2003-05-10 16:02:18 Re: realtime data inserts