Re: Hardware for writing/updating 12,000,000 rows per hour

From: Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>
To: Arya F <arya6000(at)gmail(dot)com>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Ron <ronljohnsonjr(at)gmail(dot)com>, pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: Hardware for writing/updating 12,000,000 rows per hour
Date: 2019-07-26 21:39:19
Message-ID: 20190726213919.GA16850@alvherre.pgsql
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 2019-Jul-26, Arya F wrote:

> I think I can modify my application to do a batch update. Right now the
> server has an HDD and it really can't handle a lot of updates and inserts
> per second. Would changing to a regular SSD be able to easily do 3000
> updates per second?

That's a pretty hard question in isolation -- you need to consider how
many indexes are there to update, whether the updated columns are
indexed or not, what the datatypes are, how much locality of access
you'll have ... I'm probably missing some other important factors. (Of
course, you'll have to tune various PG server settings to find your
sweet spot.)

I suggest that should be measuring instead of trying to guess. A
reasonably cheap way is to rent a machine somewhere with the type of
hardware you think you'll need, and run your workload there for long
enough, making sure to carefully observe important metrics such as table
size, accumulated bloat, checkpoint regime, overall I/O activity, and so
on.

--
Álvaro Herrera https://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Alvaro Herrera 2019-07-27 03:49:20 Re: DRY up GUI wiki pages
Previous Message Arya F 2019-07-26 20:31:37 Re: Hardware for writing/updating 12,000,000 rows per hour