Undefined character listed as UTF8PROC_CATEGORY_LO

Question

maartenbreddels opened this issue 4 years ago · comments

Hi all,

I found in apache/arrow#7656 that undefine characters (such as https://www.compart.com/en/unicode/U+08BE) are listed as UTF8PROC_CATEGORY_LO (using utf8proc_category). Could this be a bug?

Regards,

Maarten

Steven G. Johnson · Answer 1 · Wed Jul 08 2020 11:00:47 GMT+0800 (China Standard Time)

U+08BE was defined in Unicode 13, and Lo is correct.

Steven G. Johnson · Answer 2 · Wed Jul 08 2020 11:12:09 GMT+0800 (China Standard Time)

(It correctly returns UTF8PROC_CATEGORY_CN for currently unassigned codepoints like U+0378.)

Maarten Breddels · Answer 3 · Wed Jul 08 2020 16:05:15 GMT+0800 (China Standard Time)

You are correct, it didn't even cross my mind that Unicode changes that fast (apart from emoticons), thanks!