Re: website doc search is extremely SLOW

On Sun, 4 Jan 2004, Greg Sabino Mullane wrote:

> ------------------------------------------------------------------------------
> /usr/local/libexec/ppf_verify: pgp command failed
>
> gpg: WARNING: using insecure memory!
> gpg: please see http://www.gnupg.org/faq.html for more information
> gpg: Signature made Sun Jan 4 15:39:52 2004 AST using DSA key ID 14964AC8
> gpg: Can't check signature: public key not found
> ------------------------------------------------------------------------------
>
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
>
> > I keep searching the web hoping someone has come up with a 'tsearch2'
> > based search engine that does the spidering, but, unless its sitting right
> > in front of my eyes and I'm not seeing it, I haven't found it yet :(
>
> I wrote my own search engine for the docs back when the site was having
> problems last year, and myself and some others needed a searchable
> interface. It actually spidered the raw sgml pages themselves, and was
> fairly quick. I can resurrect this if anyone is interested. It runs
> with Perl and PostgreSQL and nothing else. :) Of course, it could probably
> be modified to feed it's sgml parsing output to tsearch as well.
>
> In the meantime, could we please switch to a simple google search? It
> would require changing one or two lines of HTML source, and at least
> there would be *something* until we get everything sorted out.

Have you checked things out since Tom -and- Bruce's suggestions?

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664