Re: speed up verifying UTF-8

From: Vladimir Sitnikov <sitnikov(dot)vladimir(at)gmail(dot)com>
To: John Naylor <john(dot)naylor(at)enterprisedb(dot)com>
Cc: Amit Khandekar <amitdkhan(dot)pg(at)gmail(dot)com>, Heikki Linnakangas <hlinnaka(at)iki(dot)fi>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: speed up verifying UTF-8
Date: 2021-07-21 16:13:07
Message-ID: CAB=Je-EBXtsSGLNz3SdUacoBD2ad+Fk_s-RNJ1sjE2d-wnY-5g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

>I'm pretty confident this improvement is architecture-independent.

Thanks for testing it with different architectures.

It looks like the same utf8_advance function is good for both fast-path and
for the slow path.
Then pg_utf8_verifychar could be removed altogether along with the
corresponding IS_*_BYTE_LEAD macros.

Vladimir

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Robert Haas 2021-07-21 16:15:41 Re: Parallel scan with SubTransGetTopmostTransaction assert coredump
Previous Message Mark Dilger 2021-07-21 16:11:49 Re: refactoring basebackup.c