xboot / libonnx

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Inference on GPU

drvshavva opened this issue · comments

Hi, Can I build and use libonnx on gpu ?

Need write a struct onnx_resolver_t, and the pass to onnx_context_alloc_from_file function

thanks for answer :)

hi again, you are saying that we need to write a struct onnx_resolver_t to infer on the gpu. Is it enough ? Is there any other need? And finally how do I change this struct onnx_resolver_t, what structure, what should I do? Many thanks in advance for all the replies :)

Writing a solver requires a lot of work, you can refer to the default version of the solver implementation