Re: [PATCHES] Include Lists for Text Search

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Teodor Sigaev <teodor(at)sigaev(dot)ru>
Cc: Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>, Simon Riggs <simon(at)2ndquadrant(dot)com>, pgsql-hackers(at)postgresql(dot)org, pgsql-patches(at)postgresql(dot)org
Subject: Re: [PATCHES] Include Lists for Text Search
Date: 2008-03-10 15:10:55
Message-ID: 24143.1205161855@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-patches

Teodor Sigaev <teodor(at)sigaev(dot)ru> writes:
>> Hmm, I can see how some middleware would help with folding or not
>> folding the input token, but what about the words coming from the
>> dictionary file (particularly the *output* lexeme)? It's not apparent
>> to me that it's sensible to try to control that from outside the
>> dictionary.

> Right now I see an significant advantage of such layer: two possible extension
> of dictionary (filtering and storing original form) are independent from nature
> of dictionary. So, instead of modifying of every dictionary we can add some
> layer, common for all dictionary. With syntax like:

> CREATE/ALTER TEXT SEARCH DICTIONARY foo (...) WITH ( filtering=on|off,
> store_original=on|off );

> Or per token's type/dictionary pair.

Well, if you think this can/should be done somewhere outside the
dictionary, should I revert the applied patch?

regards, tom lane

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Teodor Sigaev 2008-03-10 15:21:03 Re: [PATCHES] Include Lists for Text Search
Previous Message Teodor Sigaev 2008-03-10 14:59:27 Re: Include Lists for Text Search

Browse pgsql-patches by date

  From Date Subject
Next Message Tom Lane 2008-03-10 15:20:40 Re: Very slow (2 tuples/second) sequential scan after bulk insert; speed returns to ~500 tuples/second after commit
Previous Message Craig Ringer 2008-03-10 15:10:00 Re: Very slow (2 tuples/second) sequential scan after bulk insert; speed returns to ~500 tuples/second after commit