Unreal Engine 5, onnx, pose estimation
Here's my try to understand how to use ml models inside of UE using ONNX
biggest question for now is how to move bones from code ? (for example how to pass the pose from cpp into animinstance) https://forums.unrealengine.com/t/how-to-load-and-move-skeleton-asset-in-cpp-code/1284585
result of onnx converted model inside Unreal engine (check folder Content/Models)
left pytorch model, right converted to onnx model without quantization
colab for model conversion https://colab.research.google.com/drive/1oCpRIkPRSYDJXjwHbV2_Ev1Clhbomm6a?usp=sharing
onnx model (put it in Content/Models, but in general onnx related funcs inside PoseEstNN class, and I created NCharacter to debug the functionality, other files (ControlRig,AnimInst are experimental and mostly related to pose movement) https://drive.google.com/file/d/1TLeWyKgyjytdys2OejjyX2E6PiaQmr3G/view?usp=sharing
painting: Christ Crucified by Diego Velázquez