xboot / libonnx

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question: Does libonnx support dynamic shape/CUDA ?

delldu opened this issue · comments

Dear friends,
Thanks for good job.
We have two question: 1) Does libonnx support dynamic shape input ? If not, how to implement it ? (Just some hints.);
2) How to support CUDA inference on libonnx ?

see struct onnx_tensor_t, this can expressd for any data type, CUDA inference, you must write a struct onnx_resolver_t, this is a iterface for some hardware acceleration

@jianjunjiang ,Thank you. We also wonder how support dynamic input shape with libonnx ? Would you please give us some advance ?

Many thanks.