utf-8 support for FBX files

Question

utf-8 support for FBX files

trethaller opened this issue 3 years ago · comments

FBX files containing non ANSI characters (like "Cheminée") will be correctly converted on JS but not HL, where the recorded length of the string will not take into account the extra utf-8 bytes, causing the binary load to blow up.

Pavel Alexandrov · Answer 1 · Wed Nov 10 2021 23:13:30 GMT+0800 (China Standard Time)

Does it explode on decoding or on encoding to HMD?
In case it explodes on decoding:
hxd.fmt.fbx.Parser:187 - bytes.getString() defaults to UTF8 encoding based on documentation.
If it fails, that means that Autodesk FBX encoders blatantly do stupid thing and encode the string character length, not byte length (and then cause lots of issues with compatibility with Blender, that's what we get for using proprietary undocumented format)
Also weird that it works fine on JS.

Nicolas Cannasse · Answer 2 · Thu Nov 11 2021 05:48:00 GMT+0800 (China Standard Time)

There was no problem with reading FBX binary so most likely they correctly give the number of bytes but the string bytes themselves are not UTF-8 encoded, leading to bugs later. @trethaller maybe post a small binary FBX sample so it can be reproduced ?

…

On Wed, Nov 10, 2021 at 4:13 PM Pavel Alexandrov ***@***.***> wrote: Does it explode on decoding or on encoding to HMD? In case it explodes on decoding: hxd.fmt.fbx.Parser:187 - bytes.getString() defaults to UTF8 encoding based on documentation. If it fails, that means that Autodesk FBX encoders blatantly do stupid thing and encode the string character length, not byte length (and then cause lots of issues with compatibility with Blender, that's what we get for using proprietary undocumented format) — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#1020 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAHZXQDO3GONYHA7HZ6KHDTULKD2LANCNFSM5HXR4XKA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.