pgsql: Text parser rewritten: - supports multibyte encodings

From: teodor(at)svr1(dot)postgresql(dot)org (Teodor Sigaev)
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Text parser rewritten: - supports multibyte encodings
Date: 2005-11-21 12:27:58
Message-ID: 20051121122758.23AF8D9B82@svr1.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Log Message:
-----------
Text parser rewritten:
- supports multibyte encodings
- more strict rules for lexemes
- flex isn't used
Add:
- tsquery plainto_tsquery(text)
Function makes tsquery from plain text.
- &&, ||, !! operation for tsquery for combining
tsquery from it's parts: 'foo & bar' || 'asd' => 'foo & bar | asd'

Modified Files:
--------------
pgsql/contrib/tsearch2:
Makefile (r1.11 -> r1.12)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/Makefile.diff?r1=1.11&r2=1.12)
query.c (r1.20 -> r1.21)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/query.c.diff?r1=1.20&r2=1.21)
query_support.c (r1.1 -> r1.2)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/query_support.c.diff?r1=1.1&r2=1.2)
tsearch.sql.in (r1.13 -> r1.14)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/tsearch.sql.in.diff?r1=1.13&r2=1.14)
wparser_def.c (r1.13 -> r1.14)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/wparser_def.c.diff?r1=1.13&r2=1.14)
pgsql/contrib/tsearch2/expected:
tsearch2.out (r1.15 -> r1.16)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/expected/tsearch2.out.diff?r1=1.15&r2=1.16)
pgsql/contrib/tsearch2/sql:
tsearch2.sql (r1.9 -> r1.10)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/sql/tsearch2.sql.diff?r1=1.9&r2=1.10)
pgsql/contrib/tsearch2/wordparser:
Makefile (r1.8 -> r1.9)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/wordparser/Makefile.diff?r1=1.8&r2=1.9)
deflex.c (r1.2 -> r1.3)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/wordparser/deflex.c.diff?r1=1.2&r2=1.3)
deflex.h (r1.1 -> r1.2)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/wordparser/deflex.h.diff?r1=1.1&r2=1.2)
parser.h (r1.4 -> r1.5)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/wordparser/parser.h.diff?r1=1.4&r2=1.5)

Added Files:
-----------
pgsql/contrib/tsearch2:
ts_locale.c (r1.1)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/ts_locale.c?rev=1.1&content-type=text/x-cvsweb-markup)
ts_locale.h (r1.1)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/ts_locale.h?rev=1.1&content-type=text/x-cvsweb-markup)
pgsql/contrib/tsearch2/wordparser:
parser.c (r1.1)
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/wordparser/parser.c?rev=1.1&content-type=text/x-cvsweb-markup)

Removed Files:
-------------
pgsql/contrib/tsearch2/wordparser:
parser.l
(http://developer.postgresql.org/cvsweb.cgi/pgsql/contrib/tsearch2/wordparser/parser.l)

Browse pgsql-committers by date

  From Date Subject
Next Message User Andrewd 2005-11-21 12:34:37 pgbuildfarm - client-code: don't send log tar if the failure is from
Previous Message User T-ishii 2005-11-21 10:07:10 pgpool - pgpool: Add PostgreSQL 8.1 as a working PostgreSQL version