Skip site navigation (1) Skip section navigation (2)

Re: Any tool/script available which can be used to measure scalability of an application's database.

From: B Sreejith <bsreejithin(at)gmail(dot)com>
To: Craig Ringer <ringerc(at)ringerc(dot)id(dot)au>
Cc: "sreejith(dot) balakrishnan" <sreejith(dot)balakrishnan(at)tcs(dot)com>, pgsql-performance(at)postgresql(dot)org, Robert Klemme <shortcutter(at)googlemail(dot)com>
Subject: Re: Any tool/script available which can be used to measure scalability of an application's database.
Date: 2012-07-14 09:50:01
Message-ID: CANVt3iYn_VUvxPDs67smQbCUsRuGejwHeHWm_itgGbVCxeUgKA@mail.gmail.com (view raw or flat)
Thread:
Lists: pgsql-performance
Dear All,
Thanks alot for all the invaluable comments.
Regards,
  Sreejith.
On Jul 14, 2012 2:19 PM, "Craig Ringer" <ringerc(at)ringerc(dot)id(dot)au> wrote:

>  On 07/14/2012 09:26 AM, B Sreejith wrote:
>
> Dear Robert,
>
> We need to scale up both size and load.
> Could you please provide steps I need to follow.
>
>
> For load, first you need to build a representative sample of your
> application's querying patterns by logging queries and analysing the logs.
> Produce a load generator based on that data, set up a test copy of your
> database, and start pushing the query rate up to see what happens.
>
> For simpler loads you can write a transaction script for pgbench based on
> your queries.
>
> For size: Copy your data set, then start duplicating it with munged
> copies. Repeat, then use the load generator you wrote for the first part to
> see how scaling the data up affects your queries. See if anything is
> unacceptably slow (the "auto_explain" module is useful here) and examine it.
>
> The truth is that predicting how complex database driven apps will scale
> is insanely hard, because access patterns change as data sizes and user
> counts grow. You're likely to land up tuning for a scenario that's quite
> different to the one that you actually face when you start hitting scaling
> limitations. This doesn't mean you should not investigate, it just means
> your trials don't prove anything and the optimisations you make based on
> what you learn may not gain you much.
>
> --
> Craig Ringer
>

In response to

Responses

pgsql-performance by date

Next:From: Robert KlemmeDate: 2012-07-14 12:17:48
Subject: Re: Any tool/script available which can be used to measure scalability of an application's database.
Previous:From: John JonesDate: 2012-07-14 09:10:59
Subject: Re: Any tool/script available which can be used to measure scalability of an application's database.

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group