Re: SSDs with Postgresql?

From: Greg Smith <greg(at)2ndQuadrant(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: SSDs with Postgresql?
Date: 2011-04-29 06:35:00
Message-ID: 4DBA5C14.6020105@2ndQuadrant.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 04/26/2011 10:30 AM, Toby Corkindale wrote:
> I see Intel is/was claiming their SLC SSDs had a *minimum* lifetime of
> 2PB in writes for their 64GB disks; for your customer with a 50GB db
> and 20GB/day of WAL, that would work out at a minimum lifetime of a
> million days, or about 273 years!
> The cheaper "consumer grade" MLC drives should still last minimum 5 years at 20GB/day according to their literature. (And what I found was fairly out of date)
> That doesn't seem too bad to me - I don't think I've worked anywhere that keeps their traditional spinning disks in service beyond 5 years either.
>

The comment I made there was that the 20GB/day system was a very small
customer. One busy server, who are also the ones most likely to want
SSD, I just watched recently chug through 16MB of WAL every 3
seconds=450GB/day. Now, you're right that those systems also aren't
running with a tiny amount of flash, either. But the write volume
scales along with the size, too. If you're heavily updating records in
particular, the WAL volume can be huge relative to the drive space
needed to store the result.

As for the idea that I'm just singling out one anecdote, I have
terabytes of lost data on multiple systems behind my negativity here. I
was just pointing out a public failure that included some post-mortem I
liked. I'm not sure if I have any happy customers who were early
adopters of regular SLC or MLC drives really; the disaster rate is very
close to 100% for the first few generations of those drives I've seen,
and I've been around 50-ish of them. I'm hoping the current models
shipping now are better, getting the write cache stuff sorted out better
will be a big help. But it's been a scary technology for database use
so far. The published numbers from the manufacturer literature are a
very rosy best case when you're hitting the disk with this type of workload.

--
Greg Smith 2ndQuadrant US greg(at)2ndQuadrant(dot)com Baltimore, MD
PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us
"PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Darren Duncan 2011-04-29 06:39:37 Re: schemas for organizing tables
Previous Message Toby Corkindale 2011-04-29 04:32:43 Re: SSDs with Postgresql?