Re: Database object names and libpq in UTF-8 locale on Windows

On 10/22/2012 12:53 PM, Sebastien FLAESCH wrote:

[Issues with unquoted utf8 identifiers in Windows 1252 locale]

>> I suspect this has something to do with the fact that non-quoted
>> identifiers
>> are converted to lowercase, and because my LC_CTYPE is English_United
>> States.1252,
>> the conversion to lowercase fails...

Quite possibly. The code comment says this:

/*
* SQL99 specifies Unicode-aware case normalization, which we
don't yet
* have the infrastructure for. Instead we use tolower() to
provide a
* locale-aware translation. However, there are some locales
where this
* is not right either (eg, Turkish may do strange things with
'i' and
* 'I'). Our current compromise is to use tolower() for
characters with
* the high bit set, and use an ASCII-only downcasing for 7-bit
* characters.
*/

For now your best bet is probably not to use UTF8 non-ascii chars or to
quote the identifiers.

Given we're calling to_lower() on a single byte in the code referred to,
should we even be doing that when we have a multi-byte encoding and the
high bit is set?

Aside: I'd love to fix up our treatment of identifiers, but there is
probably a LOT of very tedious work involved.

cheers

andrew