Re: Any tool/script available which can be used to measure scalability of an application's database.

From: John Jones <idolchatter(at)gmail(dot)com>
To: Craig Ringer <ringerc(at)ringerc(dot)id(dot)au>
Cc: B Sreejith <bsreejithin(at)gmail(dot)com>, Robert Klemme <shortcutter(at)googlemail(dot)com>, pgsql-performance(at)postgresql(dot)org, "sreejith(dot) balakrishnan" <sreejith(dot)balakrishnan(at)tcs(dot)com>
Subject: Re: Any tool/script available which can be used to measure scalability of an application's database.
Date: 2012-07-14 09:10:59
Message-ID: CAL8pNqyfqaWyAH4fXK8azpen9qb4NN=KEmZtu3mZXO71L9LiiA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Hammerora is a good start but does have some issues when trying to get it
started. You can also try PGBench. As someone said, there is a plethora of
choices. It all depends on what you want to measure or accomplish.

John Jones

On Sat, Jul 14, 2012 at 1:48 AM, Craig Ringer <ringerc(at)ringerc(dot)id(dot)au> wrote:

> On 07/14/2012 09:26 AM, B Sreejith wrote:
>
> Dear Robert,
>
> We need to scale up both size and load.
> Could you please provide steps I need to follow.
>
>
> For load, first you need to build a representative sample of your
> application's querying patterns by logging queries and analysing the logs.
> Produce a load generator based on that data, set up a test copy of your
> database, and start pushing the query rate up to see what happens.
>
> For simpler loads you can write a transaction script for pgbench based on
> your queries.
>
> For size: Copy your data set, then start duplicating it with munged
> copies. Repeat, then use the load generator you wrote for the first part to
> see how scaling the data up affects your queries. See if anything is
> unacceptably slow (the "auto_explain" module is useful here) and examine it.
>
> The truth is that predicting how complex database driven apps will scale
> is insanely hard, because access patterns change as data sizes and user
> counts grow. You're likely to land up tuning for a scenario that's quite
> different to the one that you actually face when you start hitting scaling
> limitations. This doesn't mean you should not investigate, it just means
> your trials don't prove anything and the optimisations you make based on
> what you learn may not gain you much.
>
> --
> Craig Ringer
>

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message B Sreejith 2012-07-14 09:50:01 Re: Any tool/script available which can be used to measure scalability of an application's database.
Previous Message Craig Ringer 2012-07-14 08:48:57 Re: Any tool/script available which can be used to measure scalability of an application's database.