Re: Just to give an idea ...

On Sat, 5 Jun 2004, Gavin M. Roy wrote:

> If we want to offset the load by moving pgfoundry to one of my servers
> temporarily until you guys get your new servers and what not in place,
> I'd be happy to host it, if it helps.

altho that is an option, I made some changes to the servers this weekend
that seem to be holding load down ... we'll see how the 'weekday traffic'
changes that ...

but, also, Jan Wieck took a scan through the schema for pgfoundry at
Andrew's request, and it looks like there are several areas for
improvement there ;(

>
> Gavin
>
> On Sat, 5 Jun 2004 11:19:04 -0300 (ADT), Marc G. Fournier
> <scrappy(at)postgresql(dot)org> wrote:
>>
>>
>> Top ten processes on mars (where pgfoundry and archives are located):
>>
>> USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND
>> www 41463 17.3 0.1 12364 5808 ?? SJ 11:00AM 0:05.75 /usr/local/sbin/httpd
>> www 20583 13.5 0.1 12688 6172 ?? RJ 2:00PM 195:45.65 /usr/local/sbin/httpd
>> www 41053 12.2 0.1 12372 5840 ?? SJ 10:56AM 0:28.14 /usr/local/sbin/httpd
>> www 56570 12.3 0.3 21336 12012 ?? RJ Wed11PM 264:32.06 /usr/local/sbin/httpd
>> www 56572 12.5 0.3 21388 12072 ?? RJ Wed11PM 258:55.67 /usr/local/sbin/httpd
>> www 41792 11.9 0.1 12368 5800 ?? SJ 11:00AM 0:01.19 /usr/local/sbin/httpd
>> www 41778 10.5 0.1 12376 5824 ?? SJ 11:00AM 0:04.47 /usr/local/sbin/httpd
>> www 20582 9.0 0.2 13192 6752 ?? SJ 2:00PM 195:51.63 /usr/local/sbin/httpd
>> 60 41798 6.6 0.1 21012 2296 ?? SJ 11:00AM 0:00.38 lmtpd
>> scrappy 41795 6.4 0.0 2220 1408 ?? SJ 11:00AM 0:00.47 cleanup -z -t unix -u
>>
>> and, process map'ng to the VMs:
>>
>> # cat /proc/{41463,20583,41053,56570,56572,41792,41778,20582,41798,41795}/status
>> cat: /proc/41463/status: No such file or directory
>> httpd 11651,690738 nochan 80 80 80,80,80 svr5.postgresql.org
>> httpd 41,778660 select 80 80 80,80,80 svr5.postgresql.org
>> httpd 15453,319902 nochan 80 80 80,80,80 pgfoundry.org
>> httpd 15130,154111 nochan 80 80 80,80,80 pgfoundry.org
>> cat: /proc/41792/status: No such file or directory
>> cat: /proc/41778/status: No such file or directory
>> httpd 11656,301638 nochan 80 80 80,80,80 svr5.postgresql.org
>> lmtpd 0,365833 select 60 60 60,60,60 up4.com
>> cleanup 0,462244 select 1001 1001 1001,1001,1001,6 up4.com
>>
>> and all the high %CPU ones are postgresql.org related ...
>>
>> also, postgresql.org generates ~298GB of traffic per month, which accounts
>> for ~56% of all traffic out of the servers (and that isn't included what I
>> put onto our offsite server for ftp/bittorrent, it used to be ~75% of the
>> traffic), while hub.org (non client) generates ~175GB (or ~33%) ...
>>
>> Most (if not 90%) of the paying clients are static pages that are lucky to
>> generate 100MB of traffic (and note that traffic is all traffic,
>> mail/web/ssh/ftp/etc) ...
>>
>> The point: before accusing "hub clients" of loading the servers, realize
>> that ~50% of the resources are used by postgresql.org, not by clients ...
>>
>> ----
>> Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
>> Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664
>>
>> ---------------------------(end of broadcast)---------------------------
>> TIP 5: Have you checked our extensive FAQ?
>>
>> http://www.postgresql.org/docs/faqs/FAQ.html
>>
>

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664