nihui / OnnxSlim

A Toolkit to Help Optimize Large Onnx Model

OnnxSlim

OnnxSlim can help you slim your onnx model, with less operators, but same accuracy, better inference speed.

• 🚀 OnnxSlim is merged to mnn-llm, performance increased by 5%

Installation

Using Prebuilt

pip install onnxslim

Build From Source

pip install .

How to use

onnxslim your_onnx_model slimmed_onnx_model

For more usage, see onnxslim -h or refer to our examples

References

• onnx-graphsurgeon
• Polygraphy
• onnx-simplifier
• tabulate

Contact

QQ Group: 873569894