Re: full-text indexing

From: Maarten Boekhold <maarten(dot)boekhold(at)tibcofinance(dot)com>
To: "Brett W(dot) McCoy" <bmccoy(at)chapelperilous(dot)net>
Cc: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>, pgsql-general(at)postgresql(dot)org
Subject: Re: full-text indexing
Date: 2000-04-20 09:06:44
Message-ID: 38FEC8A4.A38C04BC@tibcofinance.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi,

I guess that 'original author' would be me....

> > With the original author, testing was fast, but when he loaded all the
> > data, it got very slow. The problem was that as soon as his data
> > exceeded the buffer cache, performance became terrible.
>
> How much data are we talking here? How can one get around this buffer
> cache problem?

This is all from head, but if I remember correctly, the main table had about
750.000 rows, of which one varchar(25) field was fti'ed ('full text indexed'
:),
resulting in some 5 million rows in the fti table.

wrt file sizes, I don't really remember. If you're really interested, I can
make another setup to check this (over easter time).

I'm curious: Bruce mentioned buffer cache sizes. What exactly is this buffer
cache
used for? I thought we relied on the OS filesystem caching to cache database
files?
What will increasing buffer caches give me?

Maarten

--

Maarten Boekhold, maarten(dot)boekhold(at)tibcofinance(dot)com
TIBCO Finance Technology Inc.
"Sevilla" Building
Entrada 308
1096 ED Amsterdam, The Netherlands
tel: +31 20 6601000 (direct: +31 20 6601066)
fax: +31 20 6601005
http://www.tibcofinance.com

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Brett W. McCoy 2000-04-20 11:14:26 Re: Full text indexing.
Previous Message Moray McConnachie 2000-04-20 09:06:11 Re: PostgreSQL hats, shirts, keychains, mugs