pgsql: Optimization for lower(), upper(), casefold() functions.

From: Jeff Davis <jdavis(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Optimization for lower(), upper(), casefold() functions.
Date: 2025-03-15 20:04:41
Message-ID: E1ttXkP-002e0z-2M@gemulon.postgresql.org
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Optimization for lower(), upper(), casefold() functions.

Improve performance and reduce table sizes for case mapping.

The main case mapping table stores only 16-bit offsets, which can be
used to look up the mapped code point in any of the case tables (fold,
lower, upper, or title case). Simple case pairs point to the same
offsets.

Generate a function in generate-unicode_case_table.pl that consists of
a nested branches to test for specific codepoint ranges that determine
the offset in the main table.

Other approaches were considered, such as representing these ranges as
another structure (rather than branches in a generated function), or a
different approach such as a radix tree, or perfect hashing. The
author implemented and tested these alternatives and settled on the
generated branches.

Author: Alexander Borisov <lex(dot)borisov(at)gmail(dot)com>
Reviewed-by: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>
Discussion: https://postgr.es/m/7cac7e66-9a3b-4e3f-a997-42aa0c401f80%40gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/27bdec06841d1bb004ca7627eac97808b08a7ac7

Modified Files
--------------
src/common/unicode/generate-unicode_case_table.pl | 388 +-
src/common/unicode_case.c | 80 +-
src/include/common/unicode_case_table.h | 16418 ++++++++++++++++----
3 files changed, 13671 insertions(+), 3215 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Andrew Dunstan 2025-03-15 21:44:26 pgsql: Silence perl critic
Previous Message Melanie Plageman 2025-03-15 14:38:13 pgsql: Remove table AM callback scan_bitmap_next_block