Re: [RFC] Localized literals

From: Zoltan Boszormenyi <zb(at)cybertec(dot)at>
To: Martijn van Oosterhout <kleptog(at)svana(dot)org>
Cc: PGSQL Hackers <pgsql-hackers(at)postgresql(dot)org>, Hans-Juergen Schoenig <hs(at)cybertec(dot)at>
Subject: Re: [RFC] Localized literals
Date: 2008-04-23 09:42:50
Message-ID: 480F049A.9090606@cybertec.at
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Martijn van Oosterhout írta:
> On Wed, Apr 23, 2008 at 10:02:37AM +0200, Zoltan Boszormenyi wrote:
>
>> But the question popped up whether PostgreSQL can be extended
>> to allow localized literals and apply encoding conversion the same
>> way as on string data. NAMEDATA can be replaced with regular TEXT
>> and have the same conversion everywhere. This way the relation and
>> field name limits are also eliminated. The conversion could be controlled
>> by a compile-time option and/or a GUC variable. Tell me if I am crazy.
>>
>
> It does convert the table names also, since the encoding translation is
> applied to the whole query string, not just normal strings.

Thanks for enlightenment, I didn't know or check it.

> A simple
> SET CLIENT_ENCODING='latin9' at the beginning of your dump should have
> worked.
>

I thought so - the dump was off a 7.4 server with its pg_dump
and there was no "SET client_encoding = ..." in the script.
They insisted on continuing with LATIN9 but with the default
UTF-8 server encoding createdb -E LATIN9 failed.

> As for the other point, the reason NAMEDATA is fixed is because these
> records is mapped onto in memory structures in the backend. By changing
> it to a variable length type all structure accesses would become much
> more expensive.
>

Yes, I guessed it would be slower. However, NAMEDATALEN
doesn't translate to the varchar(NAMEDATALEN) if I use accented
characters in literals with UTF-8 encoding. :-(

> But none of this has anything ot do with encodings.
>
> Have a nice day,
>

Thanks, I have it. :-)

Best regards,
Zoltán Böszörményi

--
----------------------------------
Zoltán Böszörményi
Cybertec Schönig & Schönig GmbH
http://www.postgresql.at/

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message PFC 2008-04-23 13:11:05 Re: Per-table random_page_cost for tables that we know are always cached
Previous Message Magnus Hagander 2008-04-23 09:18:56 Re: pgkill on win32