Re: Ready to launch?

From: Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>
To: Dave Page <dpage(at)vale-housing(dot)co(dot)uk>
Cc: Steve Simms <steve(at)deefs(dot)net>, pgsql-www(at)postgresql(dot)org
Subject: Re: Ready to launch?
Date: 2004-12-22 15:19:31
Message-ID: Pine.GSO.4.61.0412221816240.3825@ra.sai.msu.su
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-www

On Wed, 22 Dec 2004, Dave Page wrote:

>
>
>> -----Original Message-----
>> From: Oleg Bartunov [mailto:oleg(at)sai(dot)msu(dot)su]
>> Sent: 22 December 2004 13:26
>> To: Dave Page
>> Cc: Steve Simms; pgsql-www(at)postgresql(dot)org
>> Subject: RE: [pgsql-www] Ready to launch?
>>
>> How much pages rebuildes and does everything rebuilded each run,
>> regardless on changes ?
>> 20+ minutes looks too much for medium sized server.
>>
>
> It builds around 10,000 pages, and does so by spidering the site as an
> indexer would, and saving the output. It's clearly not the most
> efficient way, but given the number of different ways that pages get
> built on the site, it is certainly the most maintainable.
>
> I have a suspicion that it might not be avoiding saving duplicate links
> but I haven't checked that yet.

if you spidering via http you could ask if page was modified since last rebuild
and you'll save a lot. Check is your servers actually provides such information,
probably you need to configure them properly.

>
> Regards, Dave
>
> ---------------------------(end of broadcast)---------------------------
> TIP 7: don't forget to increase your free space map settings
>

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83

In response to

Browse pgsql-www by date

  From Date Subject
Next Message Oleg Bartunov 2004-12-22 15:21:54 Re: Ready to launch?
Previous Message Dave Page 2004-12-22 15:18:05 Re: [webmaster] New site