> -----Original Message-----
> From: pgsql-www-owner(at)postgresql(dot)org
> [mailto:pgsql-www-owner(at)postgresql(dot)org] On Behalf Of Alexey Borzov
> Sent: 17 June 2004 15:19
> To: pgsql-www(at)postgresql(dot)org
> Subject: [pgsql-www] Static mirror generation
> I've commited a script for static mirror generation. Unlike
> previous such scripts, it is just a generic spider that
> follows links and does not have any knowledge about the site
> structure. This immediately helped to fix several problems.
> The mirror of website not including docs is generated in ~5
> minutes. I don't yet know how long it will take with all the
> docs, got tired after the first 1,5 hours.
Meep, that's slow. The current build takes just a few minutes when the
server is behaving. Still, the idea of using a crawler is a good one -
at least that way nothing will get forgotten, and presumably it will
create a report of any broken links?
> I've set up a proof-of-concept static mirror @
> The mirror uses Apache's content negotiation, so that if you
> have Russian set up as the preferred language in your
> browser, it'll come up in Russian, else in English.
OK, sounds good. Nice work :-)
pgsql-www by date
|Next:||From: Alexey Borzov||Date: 2004-06-18 08:30:02|
|Subject: Re: Static mirror generation|
|Previous:||From: Marc G. Fournier||Date: 2004-06-18 02:02:33|
|Subject: Re: New News Entry|