From: | Alexey Borzov <borz_off(at)cs(dot)msu(dot)su> |
---|---|
To: | Dave Page <dpage(at)vale-housing(dot)co(dot)uk> |
Cc: | pgsql-www(at)postgresql(dot)org |
Subject: | Re: Ready to launch? |
Date: | 2004-12-22 15:01:14 |
Message-ID: | 41C98C3A.1030406@cs.msu.su |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-www |
Hi,
Dave Page wrote:
>>Do you spider all the static docs every time? They only need to be
>>regenerated on design change or docs update after a new release.
>
> At the moment it spiders the whole site, exactly as you wrote it (with
> the exception that it ignores /redir).
Yes, I also wrote it to accept a -r preg_pattern command line switch.
Running it like mirror.php -r "~/static/~" (not tested) may do the trick...
The script also knows the standard -h / --help switch, BTW...
> Would it? I don't know how many links there are to the doc sets. Mind
> you, I suppose each doc links to the next and previous, so it would hit
> each at least 3 times which it clearly isn't.
Of course, the saved links are remembered and are not crawled again.
From | Date | Subject | |
---|---|---|---|
Next Message | Dave Page | 2004-12-22 15:18:05 | Re: [webmaster] New site |
Previous Message | Dave Page | 2004-12-22 14:50:57 | Re: Ready to launch? |