From: | Oleg Bartunov <oleg(at)sai(dot)msu(dot)su> |
---|---|
To: | Marek Lewczuk <newsy(at)lewczuk(dot)com> |
Cc: | pg(at)fastcrypt(dot)com, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org> |
Subject: | Re: [HACKERS] Announce: Search PostgreSQL related resources |
Date: | 2004-01-05 17:52:30 |
Message-ID: | Pine.GSO.4.58.0401052045540.3406@ra.sai.msu.su |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general pgsql-hackers |
On Mon, 5 Jan 2004, Marek Lewczuk wrote:
> Dave Cramer wrote:
> > connection failed :(
> works for me... :-) (poland)
>
We have small downtime because of upgrading server software, so this may
be a reason for the problem. We're in stage of optimizing crawler because
some sites are very-very ugly, for example, our crawler have discovered
2 millions URLs on http://ems-hitech.com/pgmanager/ ! 99.99 % of URLs are
just 404 (document not found), but server does return 200 code )\:)
So we have to explicitly exclude these pages. btw, archives.postgresql.org
doesn't returns modification date in header. This prevent crawler to
optimize downloading process. So, there are many problems, but we hope
soon we'll tune crawling process. I estimate average time to refresh index
about 1 week.
>
>
Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83
From | Date | Subject | |
---|---|---|---|
Next Message | tatyana.krasnokutsky | 2004-01-05 17:53:04 | start/stop a database |
Previous Message | Thomas Beutin | 2004-01-05 16:17:08 | Re: Slow Performance with 7.4.1 |
From | Date | Subject | |
---|---|---|---|
Next Message | Keith Bottner | 2004-01-05 18:28:28 | planner, how difficult to ... |
Previous Message | Peter Eisentraut | 2004-01-05 17:51:24 | Re: Permissions and PGSQL |