Skip site navigation (1) Skip section navigation (2)

Re: Wich hardware suits best for large full-text indexed

From: Bill Moran <wmoran(at)potentialtech(dot)com>
To: Diogo Biazus <diogo(at)ikono(dot)com(dot)br>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Wich hardware suits best for large full-text indexed
Date: 2004-03-30 23:59:42
Message-ID: 406A09EE.9000605@potentialtech.com (view raw or flat)
Thread:
Lists: pgsql-general
Diogo Biazus wrote:
> Hi folks,
> 
> I have a database using tsearch2 to index 300 000 documents.
> I've already have optimized the queries, and the database is vacuumed on 
> a daily basis.
> The stat function tells me that my index has aprox. 460 000 unique words 
> (I'm using stemmer and a nice stopword list).
> The problem is performance, some queries take more than 10 seconds to 
> execute, and I'm not sure if my bottleneck is memory or io.
> The server is a Athlon XP 2000, HD ATA133, 1.5 GB RAM running postgresql 
> 7.4.3 over freebsd 5.0 with lots of shared buffers and sort_mem...
> 
> Does anyone has an idea of a more cost eficient solution?
> How to get a better performance without having to invest some 
> astronomicaly high amount of money?

This isn't hardware related, but FreeBSD 5 is not a particularly impressive
performer.  Especially 5.0 ... 5.2.1 would be better, but if you're shooting
for performance, 4.9 will probably outperform both of them at this stage of
the game.

Something to consider if the query tuning that others are helping with doesn't
solve the problem.  Follow through with that _first_ though.

However, if you insist on running 5, make sure your kernel is compiled without
WITNESS ... it speeds things up noticably.

-- 
Bill Moran
Potential Technologies
http://www.potentialtech.com


In response to

Responses

pgsql-general by date

Next:From: Will ReeseDate: 2004-03-31 00:50:50
Subject: Problem with foreign keys and locking
Previous:From: Pailloncy Jean-GĂ©rardDate: 2004-03-30 23:19:06
Subject: 7.4.1 & invalid page header in block

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group