realtime data inserts

From: "Adam Siegel" <adam(at)sycamorehq(dot)com>
To: pgsql-hackers(at)postgresql(dot)org, pgsql-performance(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: realtime data inserts
Date: 2003-05-10 15:25:16
Message-ID: b9j57m$236m$1@news.hub.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

I have realtime data flowing at a rate of 500, 512 byte packets per second.
I want to log the info in a database table with two other columns, one for a
timestamp and one for a name of the packet. The max rate I can achieve is
350 inserts per second on a sun blade 2000. The inserts are grouped in a
transaction and I commit every 1200 records. I am storing the binary data
in a bytea. I am using the libpq conversion function. Not sure if that is
slowing me down. But I think it is the insert not the conversion.

Any thoughts on how to achive this goal?

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Mathieu Arnold 2003-05-10 15:48:26 pg_dump && tar && /tmp
Previous Message Ian Barwick 2003-05-10 09:50:29 Re: Unicode confusion

Browse pgsql-hackers by date

  From Date Subject
Next Message Jim C. Nasby 2003-05-10 15:53:09 Re: Plans for index names unique to a table?
Previous Message Kurt Roeckx 2003-05-10 11:53:10 Re: rint() replacement

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2003-05-10 16:00:02 Re: realtime data inserts
Previous Message Achilleus Mantzios 2003-05-09 19:25:12 Re: An unresolved performance problem.