Re: tsvector field length limitation

From: Jonathan Marks <jonathanaverymarks(at)gmail(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: tsvector field length limitation
Date: 2018-06-20 15:40:53
Message-ID: 09ECA82E-C221-4D79-B2FC-5493F330B6EB@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

What if we just didn’t use positional arguments at all? I.e. we just populate the tsvector with lexemes only?

> On Jun 20, 2018, at 10:49 AM, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:
>
> Jonathan Marks <jonathanaverymarks(at)gmail(dot)com> writes:
>> ... we run into the max tsvector length requirement "The length of a tsvector (lexemes + positions) must be less than 1 megabyte”
>
>> Is there any way to disable or increase that limit in Postgres 10.3?
>
> No; it's forced by the representation used for tsvector, which stores
> lexeme offsets in 20-bit fields (cf WordEntry in
> src/include/tsearch/ts_type.h). Perhaps that was short-sighted but
> I don't foresee it changing anytime soon. You'd more or less need
> a whole new datatype ("bigtsvector"?) to make it happen.
>
> regards, tom lane

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Andres Freund 2018-06-20 15:51:48 Re: found xmin from before relfrozenxid on pg_catalog.pg_authid
Previous Message Igor Korot 2018-06-20 15:20:34 Re: Is there a way to be notified on the CREATE TABLE execution?