Re: BUG #19341: REPLACE() fails to match final character when using nondeterministic ICU collation

On 02/12/2025 18:24, Laurenz Albe wrote:
> On Tue, 2025-12-02 at 10:03 +0000, PG Bug reporting form wrote:
>> PostgreSQL version: 18.1
>>
>> When using a nondeterministic ICU collation, the replace() function fails to
>> replace a substring when that substring appears at the end of the input
>> string.
>>
>> Occurrences of the same substring earlier in the string are replaced
>> normally.
>>
>> Specific collation used:
>> create collation test_nondeterministic (
>> provider = icu,
>> locale = 'und-u-ks-level2',
>> deterministic = false
>> )
>>
>> -- Replace final character under nondeterministic collation
>> SELECT replace(
>> 'testx' COLLATE "test_nondeterministic",
>> 'x' COLLATE "test_nondeterministic",
>> 'y') AS res1;
>
> I can reproduce the problem, and the attached patch fixes it for me.

+1, looks good to me. Let's also add a regression test for this.

> I am not certain if it is safe to apply pg_mblen() to "haystack_end", though.

It doesn't do that though, does it? There are two pg_mblen() calls in
the vicinity:

> for (const char *test_end = hptr; test_end <= haystack_end; test_end += pg_mblen(test_end))
> {
> if (pg_strncoll(hptr, (test_end - hptr), needle, needle_len, state->locale) == 0)
> {
> state->last_match_len_tmp = (test_end - hptr);
> result_hptr = hptr;
> if (!state->greedy)
> break;
> }
> }
> if (result_hptr)
> break;
>
> hptr += pg_mblen(hptr);

Neither of those will get called with 'haystack_end' as far as I can see.

- Heikki