Re: Hardware recommendations to scale to silly load

From: Andrew Sullivan <andrew(at)libertyrms(dot)info>
To: pgsql-performance(at)postgresql(dot)org
Subject: Re: Hardware recommendations to scale to silly load
Date: 2003-08-27 11:40:07
Message-ID: 20030827114007.GD13190@libertyrms.info
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

On Wed, Aug 27, 2003 at 02:35:13AM +0100, matt wrote:

> I need to increase the overall performance by a factor of 10, while at
> the same time the DB size increases by a factor of 50. e.g. 3000
> inserts/updates or 25,000 selects per second, over a 25GB database with
> most used tables of 5,000,000 and 1,000,000 rows.

Your problem is mostly going to be disk related. You can only get in
there as many tuples in a second as your disk rotates per second. I
suspect what you need is really expensive disk hardware (sorry to
tell you that) set up as RAID 1+0 on fibre channel or something.
3000 write transactions per second is probably too much to ask for
any standard hardware.

But given that you are batching this once a week, and trying to avoid
big expenses, are you use this is the right approach? Perhaps you
should consider a redesign using COPY and such?

A

--
----
Andrew Sullivan 204-4141 Yonge Street
Liberty RMS Toronto, Ontario Canada
<andrew(at)libertyrms(dot)info> M2P 2A8
+1 416 646 3304 x110

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruno Wolff III 2003-08-27 12:46:49 Re: NOTICE vs WARNING
Previous Message hellwig 2003-08-27 08:42:51 Postgres & Tertiary Storage?

Browse pgsql-performance by date

  From Date Subject
Next Message Jeff 2003-08-27 12:33:34 Re: Sun vs a P2. Interesting results.
Previous Message Tomka Gergely 2003-08-27 08:56:41 Re: 8 way Intel Xeon system