Re: Hardware needed for 15,000,000 record DB?

From: David Gilbert <dgilbert(at)velocet(dot)ca>
To: Jeremy Buchmann <jeremy(at)wellsgaming(dot)com>
Cc: Curt Sampson <cjs(at)cynic(dot)net>, pgsql-admin(at)postgresql(dot)org
Subject: Re: Hardware needed for 15,000,000 record DB?
Date: 2002-04-23 17:44:40
Message-ID: 15557.40328.672259.475024@trooper.velocet.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin pgsql-novice

>>>>> "Jeremy" == Jeremy Buchmann <jeremy(at)wellsgaming(dot)com> writes:

Jeremy> Curt Sampson wrote:
>> On Mon, 22 Apr 2002, Jeremy Buchmann wrote:
>>
>>> You minimize the amount of time the I/O takes by using fast
>>> storage devices. This means SCSI.
>>
>>
>> Not necessarially. More disk arms is also a big help, so much so
>> that I would take two IDE drives (assuming that they're fast modern
>> ones) over one SCSI drive any day.

Jeremy> SCSI also has several other advantages...it doesn't suck up
Jeremy> all your CPU time when there's a lot of disk activity, and it
Jeremy> supports command queueing. IDE was designed to be cheap, SCSI
Jeremy> was designed to be good. I've used both and from my
Jeremy> experience, SCSI is The Way.

Well... I wouldn't phrase the problem that 1-dimensionally. There are
IDE drives that support queueing (IBM Deskstar something-or-other) and
some OSs have ATA controller code that really kicks but (FreeBSD, for
instance), so from a software point of view, IDE can work well.

It's even likely that the maufacturing process is nearly identical for
some makes and models.

But the RMA rates for _extreme_ usage don't match. My theory:

I find that IDE drives placed in situations where their request queue
is populated completely for days at a time will fail between 3 and 6
months where SCSI drives can last years in this condition. Pay
attention to the qualification: we're talking not even a milisecond of
unused time for at least hours on end out of a day.

I believe this is due to the SCSI disk having software that will
momentarily stop processing requests to perform a recalibration
... where IDE drives may only do this when they are idle for some
small period of time.

Dave.

--
============================================================================
|David Gilbert, Velocet Communications. | Two things can only be |
|Mail: dgilbert(at)velocet(dot)net | equal if and only if they |
|http://daveg.ca | are precisely opposite. |
=========================================================GLO================

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Bruce Momjian 2002-04-23 20:12:44 Re: books of administrating PostgreSQL
Previous Message Jeremy Buchmann 2002-04-23 17:22:48 Re: Hardware needed for 15,000,000 record DB?

Browse pgsql-novice by date

  From Date Subject
Next Message Richard A Lough 2002-04-23 19:27:44 Losing synchronisation with server
Previous Message Jeremy Buchmann 2002-04-23 17:22:48 Re: Hardware needed for 15,000,000 record DB?