Skip site navigation (1) Skip section navigation (2)

Re: [PERFORM] scalability issues on win32

From: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
To: Merlin Moncure <merlin(dot)moncure(at)rcsonline(dot)com>
Cc: Dave Page <dpage(at)vale-housing(dot)co(dot)uk>,pgsql-performance(at)postgresql(dot)org, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>,Magnus Hagander <mha(at)sollentuna(dot)net>,Win 32 hackers PGSQL <pgsql-hackers-win32(at)postgresql(dot)org>
Subject: Re: [PERFORM] scalability issues on win32
Date: 2004-12-02 19:28:17
Message-ID: 200412021928.iB2JSHo09487@candle.pha.pa.us (view raw or flat)
Thread:
Lists: pgsql-hackers-win32pgsql-performance
Merlin Moncure wrote:
> > > This was an intersting Win32/linux comparison. I expected
> > > Linux to scale better, but I was surprised how poorly XP
> > > scaled.  It reinforces our perception that Win32 is for low
> > > traffic servers.
> > 
> > That's a bit harsh given the lack of any further investigation so far
> > isn't it? Win32 can run perfectly well with other DBMSs with hundreds
> of
> > users.
> > 
> > Any chance you can profile your test runs Merlin?
> > 
> 
> Ok, I am starting to strongly suspect the statistics collector of
> various kinds of malfeasance.  Right now I am running with the stats
> collector off and I am getting much better scalability and much more
> deterministic query times...that is, even when under moderate to heavy
> load query running times are proportional to the number of users on the
> system...the system is purring like a kitten right now with over a 100
> users logged in.
> 
> This coupled with the fact that I was getting random restarts with the
> collector process makes me think that there is some kind of issue with
> the ipc between the collector and the backends that is blocking and/or
> is being improperly handled after failure.
> 
> I was running with statement level stats on under scenarios with
> extremely high levels of query activity where the server might be
> processing 500-1500 queries/second or more spread out over multiple
> backends.
> 
> I'll look into this issue more over next several days.  I'll dip back
> into the code and see if I can come up with a better
> answer...unfortunately I can't run the stats collector on until I can
> schedule another load test.

OK, the big problem is that we are nearing RC1.  We would like some
feedback on this as soon as possible.  A major Win32 cleanup for this
could delay the 8.0 release.

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman(at)candle(dot)pha(dot)pa(dot)us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073

In response to

Responses

pgsql-performance by date

Next:From: Pallav KalvaDate: 2004-12-02 19:32:53
Subject: Re: Poor Performance on a table
Previous:From: Merlin MoncureDate: 2004-12-02 19:21:53
Subject: Re: [PERFORM] scalability issues on win32

pgsql-hackers-win32 by date

Next:From: Bruce MomjianDate: 2004-12-02 19:39:12
Subject: Re: [pgsql-hackers-win32] PLTCL
Previous:From: Merlin MoncureDate: 2004-12-02 19:21:53
Subject: Re: [PERFORM] scalability issues on win32

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group