Re: HOT is applied

From: "Merlin Moncure" <mmoncure(at)gmail(dot)com>
To: "Heikki Linnakangas" <heikki(at)enterprisedb(dot)com>
Cc: "Tom Lane" <tgl(at)sss(dot)pgh(dot)pa(dot)us>, "Pavan Deolasee" <pavan(dot)deolasee(at)gmail(dot)com>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: HOT is applied
Date: 2007-09-25 02:53:45
Message-ID: b42b73150709241953q7410f7adu803214d75ea7594c@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 9/21/07, Merlin Moncure <mmoncure(at)gmail(dot)com> wrote:
> Well, my first round of results are so far not showing the big gains I
> saw with hot in some of the earlier patches...so far, it looks
> approximately to be a wash although with the reduced need to vacuum.

let me correct myself here. I did some longer runs and came up with
the following results (these runs are still not really long enough, I
need to run some more tests). The smaller, cpu bound cases were
blowout victories for hot. The largest run (i/o bound) was very close
but there were not enough transactions to force a vacuum, after which
hot would probably pull away by some degree.

one small aside: I am suspicious that 8.3 improvements to the stats
collector overhead are going to reap big benefits. This merits some
extra investigation, i think.

hardware:
2xintel 5160(at)3ghz, 4 cores total
8gb ram
5x15krpm sas, raid 0 data xfs
5x15krpm sas, raid 0, wal xfs

fsync on, asynch commit, partial page writes, autovac on

not hot build cvs dated 9/14
hot build cvs dated 9/21

merlin (results follow)

********* without hot: *********
scaling factor: 1
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 2345.225742 (including connections establishing)
tps = 2345.264846 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 10
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 3038.119776 (including connections establishing)
tps = 3038.185492 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 25
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 3671.987348 (including connections establishing)
tps = 3672.083077 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 100
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 4240.424756 (including connections establishing)
tps = 4240.542851 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 1000
number of clients: 8
number of transactions per client: 100000
number of transactions actually processed: 800000/800000
tps = 889.890173 (including connections establishing)
tps = 889.905128 (excluding connections establishing)

********* witht hot: *********
transaction type: TPC-B (sort of)
scaling factor: 1
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 3186.553423 (including connections establishing)
tps = 3186.622178 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 10
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 5123.153371 (including connections establishing)
tps = 5123.331343 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 25
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 4994.897937 (including connections establishing)
tps = 4995.075480 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 100
number of clients: 8
number of transactions per client: 250000
number of transactions actually processed: 2000000/2000000
tps = 4675.778153 (including connections establishing)
tps = 4675.936096 (excluding connections establishing)
transaction type: TPC-B (sort of)
scaling factor: 1000
number of clients: 8
number of transactions per client: 100000
number of transactions actually processed: 800000/800000
tps = 893.904762 (including connections establishing)
tps = 893.919032 (excluding connections establishing)

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2007-09-25 03:51:47 Re: MSVC build scripts status
Previous Message Andrew Dunstan 2007-09-24 22:58:48 MSVC build scripts status