ort is an (unofficial) ONNX Runtime 1.17 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference on both CPU & GPU.
๐ Documentation
๐ค Support
๐ Projects using ort
Open a PR to add your project here ๐
- Twitter uses
ortto serve homepage recommendations to hundreds of millions of users. - Bloop uses
ortto power their semantic code search feature. - pyke Diffusers uses
ortfor efficient Stable Diffusion image generation on both CPUs & GPUs. - edge-transformers uses
ortfor accelerated transformer model inference at the edge. - Ortex uses
ortfor safe ONNX Runtime bindings in Elixir.
๐ Sponsor ort
