Re: Mirror.php performance

From: Alexey Borzov <borz_off(at)cs(dot)msu(dot)su>
To: Dave Page <dpage(at)vale-housing(dot)co(dot)uk>
Cc: pgsql-www(at)postgresql(dot)org
Subject: Re: Mirror.php performance
Date: 2004-11-04 13:02:33
Message-ID: 418A2869.5090003@cs.msu.su
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-www

Hi,

Alexey Borzov wrote:
>> Nov 04 09:16:04 mirror [info] Mirroring finished. 1027 page(s) saved,
>> 1346 second(s) spent
>>
>> It appears to have saved everything in the root directory afaict, and
>> the 7.4 static docs, but nothing else.
>>
>> Any ideas?
>
> Ouch. It did the same for me, will look into this: seems as if some
> links are dropped / not followed.

Fixed. Turned out the regexes to extract links from pages were broken
and some of the links (including the main menu, unfortunately) were thus
not crawled.

In response to

Browse pgsql-www by date

  From Date Subject
Next Message Devrim GUNDUZ 2004-11-04 13:07:36 Re: New Event
Previous Message World Wide Web Owner 2004-11-04 13:01:57 New Event