From: | Greg Williamson <gwilliamson39(at)yahoo(dot)com> |
---|---|
To: | Kevin Grittner <Kevin(dot)Grittner(at)wicourts(dot)gov>, Tim <elatllat(at)gmail(dot)com>, pgsql-admin(at)postgresql(dot)org |
Subject: | Re: tsvector limitations |
Date: | 2011-06-15 05:56:26 |
Message-ID: | 453674.41390.qm@web46113.mail.sp1.yahoo.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-admin |
Kevin Grittner wrote:
> Tim <elatllat(at)gmail(dot)com> wrote:
>
<...>
> Your test (whatever data it is that you used) don't seem typical of
> English text. The entire PostgreSQL documentation in HTML form,
> when all the html files are concatenated is 11424165 bytes (11MB),
> and the tsvector of that is 364410 (356KB). I don't suppose you
> know of some publicly available file on the web that I could use to
> reproduce your problem?
Try trolling texts at the Internet Archive (archive.org) -- lots of stuff that
has been rendered into ASCII ... Government documents and the like from all
periods; novels and the like that are no longer under copyright, so lots of long
classics.
<http://www.archive.org/stream/ataleoftwocities00098gut/old/2city12p_djvu.txt>
for example ... 765K
HTH,
Greg Williamson
From | Date | Subject | |
---|---|---|---|
Next Message | Campbell, Lance | 2011-06-15 13:58:48 | Logging issue |
Previous Message | Tim | 2011-06-15 00:10:58 | Re: tsvector limitations |