Re: Simplifying Text Search

From: "Trevor Talbot" <quension(at)gmail(dot)com>
To: "Peter Eisentraut" <peter_e(at)gmx(dot)net>
Cc: "Gregory Stark" <stark(at)enterprisedb(dot)com>, pgsql-hackers(at)postgresql(dot)org, "Martijn van Oosterhout" <kleptog(at)svana(dot)org>, "Aidan Van Dyk" <aidan(at)highrise(dot)ca>, "Heikki Linnakangas" <heikki(at)enterprisedb(dot)com>, "Simon Riggs" <simon(at)2ndquadrant(dot)com>, "Tom Lane" <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Subject: Re: Simplifying Text Search
Date: 2007-11-14 02:42:46
Message-ID: 90bce5730711131842w6465f580i1b0d080322220c09@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 11/13/07, Peter Eisentraut <peter_e(at)gmx(dot)net> wrote:
> Am Dienstag, 13. November 2007 schrieb Gregory Stark:
> > "Peter Eisentraut" <peter_e(at)gmx(dot)net> writes:

> > > What we'd need is a way to convert a LIKE pattern into a tsquery
> > > ('%foo%bar%' => 'foo & bar'). Then you might even be able to sneak
> > > index-optimized text search into existing applications. Might be worth a
> > > try.

> > I don't think that's the right direction to go. Notably "%foo%bar%" isn't
> > the same thing as "foo & bar". Also most tsearch queries can't be expressed
> > as LIKE patterns anyways.

> The requirement is to express LIKE patterns as tsearch queries, not the other
> way around.

How? LIKE queries are incapable of expressing word boundaries, do not
support substitution, and are implicitly ordered. tsearch queries
operate entirely on word boundaries, may substitute words, and are
unordered.

I don't see the two as even working in the same space, let alone be
convertable for optimization purposes. If the idea was just to use a
tsearch index as an initial filter, then running LIKE on the results,
dictionary-based substitution makes that unreliable.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Jan Urbański 2007-11-14 02:48:02 Re: a tsearch2 (8.2.4) dictionary that only filters out stopwords
Previous Message Simon Riggs 2007-11-14 02:18:07 Re: Simplifying Text Search