onnx-runtime

There are 1 repository under onnx-runtime topic.

snakers4 / silero-vad
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
onnx onnx-runtime onnxruntime pytorch speech speech-processing vad voice-activity-detection voice-commands voice-control voice-detection voice-recognition
Language:Python 7279
royshil / obs-backgroundremoval
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
obs obs-plugin libobs mac-osx background-segmentation obs-studio onnx onnxruntime plugin computer-vision image-segmentation obs-studio-plugin obsproject onnx-runtime onnxruntime-gpu video-segmentation
Language:C++ 3892
StarlightSearch / EmbedAnything
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
embedding-models large-language-models machine-learning indexing rag rust rust-lang information-retrieval vision-language-model ingestion vector-database high-performance inference python vector-search production hybrid onnx-runtime onnxruntime server
Language:Rust 762
NickSwardh / YoloDotNet
YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and live video streams.
object-detection onnx onnx-runtime computer-vision video video-processing cuda detection image-classification obb segmentation yolo yolov10 yolov11 yolov8 yolov9 yolo-world yolov12 yoloe tensorrt
Language:C# 625
dme-compunet / YoloSharp
🚀 A high performance real-time object detection solution using YOLO11 ⚡️ powered by ONNX-Runtime
csharp dotnet image-classification object-detection onnx-runtime pose-estimation ultralytics yolov8 imagesharp yolo instance-segmentation yolov10 obb oriented-object-detection yolo11 yolov12
Language:C# 486
browser-ml-inference
jobergum / browser-ml-inference
Edge Inference in Browser with Transformer NLP model
nlp edge-computing transformers huggingface cloudflare-pages onnx onnx-runtime react
Language:Jupyter Notebook 314
nbigaouette / onnxruntime-rs
Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
onnxruntime onnx rust onnx-runtime onnxruntime-sys inference rust-wrapper
Language:Rust 310
FaceONNX / FaceONNX
Face recognition and analytics library based on deep neural networks and ONNX runtime
embeddings classification estimation face-analytics-library deep-neural-networks onnx face onnx-runtime landmarks detection dotnet gpu cpu face-onnx faceonnx antispoofing recognition face-detection face-recognition
Language:C# 256
triton-inference-server / onnxruntime_backend
The Triton backend for the ONNX Runtime.
backend inference onnx-runtime triton-inference-server
Language:C++ 165
Shannon-Data / ShannonBase
The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.
mysql ml-embeded htap in-memory-column-storage ai-native multi-model open-source-mysql-heatwave onnx-runtime rag embedding-vectors vectorized-execution-engine
Language:C++ 107
Yulv-git / Model-Inference-Deployment
A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
inference deployment onnx openvino tensorrt mediapipe tensorflow-lite tensorflow-serving onnx-runtime libtorch ncnn tnn mnn tvm mace paddle-lite megengine-lite openppl bolt awesome
Language:Python 70
emptysoal / tensorrt-experiment
Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.
deeplab-v3-plus image-classification image-segmentation onnx-runtime pytorch pytorch-cnn resnet-50 tensorrt tensorrt-conversion tensorrt-engine tensorrt-inference unet vgg16
Language:Python 50
COO1M / SRMaster
基于Real-ESRGAN的图片AI超分辨率安卓APP
android real-esrgan super-resolution onnx-runtime pytorch-mobile
Language:Kotlin 48
ms-iot / ros_msft_onnx
ONNX Runtime for the Robot Operating System (ROS), works on ROS1 and ROS2
onnx-runtime hardware-acceleration ros ros2
Language:C++ 38
LIU42 / FlowerClassify
基于 ResNet 的花卉分类识别系统。
cnn computer-vision deep-learning docker flask image-classification machine-learning onnx onnx-runtime pytorch
Language:Python 36
zz990099 / EasyDeploy
C++ implementations of YOLOv8, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.
inference mobilesam multi-platform nanosam onnx-runtime rknn rt-detr-v2 rtdetr sam tensorrt yolov8
Language:C++ 36
josephrocca / super-resolution-js
SOTA image super-resolution in JavaScript/Wasm using an ONNX-ported SwinIR model
image-processing image-upscaling onnx onnx-runtime super-resolution
Language:HTML 35
PT-Perkasa-Pilar-Utama / ppu-yolo-onnx-inference
Easily run YOLOv11 object detection models in a TypeScript Bun environment. No Python, PyTorch, or heavy dependencies needed.
bun bun-compatible computer-vision image-processing object-detection onnx onnx-runtime typescript yolo yolov11
Language:TypeScript 35
dineshsoudagar / local-llms-on-android
Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat - powered by ONNX Runtime.
android local-llm local-llm-integration onnx-runtime android-app chatbot huggingface-tokenizers llama3 mobile-ai offline-inference on-device-ai qwen
Language:Kotlin 33
itlab-vision / dl-benchmark
Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, PaddlePaddle, etc.
apache-tvm benchmark-framework caffe deep-learning dgl dli executorch inference inference-benchmark mxnet ncnn onnx-runtime openvino paddlepaddle pytorch spektral tensorflow tensorflow2 tflite
Language:HTML 33
chinoll / deepdanbooru_onnx
Easy-to-use danbooru anime image classification model
anime onnx onnx-models onnx-runtime onnxruntime python danbooru image-classification
Language:Python 28
renesas-rz / meta-renesas-ai
Renesas RZ/G AI BSP
armnn tensorflow-lite renesas-rz machine-learning onnx-runtime rz-g
Language:Shell 28
Mobile-Artificial-Intelligence / babylon.cpp
Babylon.cpp is a C and C++ library for grapheme to phoneme conversion and text to speech synthesis. For phonemization a ONNX runtime port of the DeepPhonemizer model is used. For speech synthesis VITS models are used. Piper models are compatible after a conversion script is run.
11labs artificial-intelligence elevenlabs g2p grapheme-to-phoneme neural-tts onnx onnxruntime phonemization test-to-speech tts vits voice-cloning deep-phonemizer onnx-models onnx-runtime
Language:Python 25
mtszkw / fast-torch
Comparing PyTorch, JIT and ONNX for inference with Transformers
onnx-runtime inference mode-inference torchscript transformers
Language:Python 20
instant-high / deoldify-onnx
Easy to install image and video colorization using onnx converted deoldify model
deoldify onnx-models onnx-runtime image-colorization video-colorization
Language:Python 19
jonathanpeppers / inclusive-code-reviews-ml
Machine learning for code reviews!
hacktoberfest machine-learning ml-dotnet onnx onnx-runtime
Language:C# 17
Ave-Sergeev / Dictator
Offline STT & VAD Service (Rust, Tonic) (Q1:2025)
rust tonic vosk audio transcribe silero voice-activity-detection speech-to-text grpc onnx-runtime transcriber
Language:Rust 9
kaiidams / Voice100AndroidApp
Voice100 Android App is a TTS/ASR sample app that uses ONNX Runtime and Voice100 neural TTS/ASR models on Xamarin. Inference of Voice100 is low cost as its models are tiny and only depend on CNN without recursion.
xamarin android onnxruntime speech-recognition speech-synthesis onnx-runtime
Language:C# 9
BinhMinhs10 / transformers_onnx
inference-onnx-model onnx-runtime transformer roberta
Language:Python 7
HighPoint / aws-lambda-onnx-model
Run ONNX machine learning models on AWS Lambda
onnx onnxruntime onnx-models aws-lambda aws-s3 lambda-layer machine-learning docker large-files onnx-runtime onnx-backend onnx-torch
Language:Python 7
ashrafgt / onnx-keras-example
Keras/Tensorflow Neural Network Conversion to ONNX and Inference with ONNX Runtime
onnx-runtime tensorflow keras machine-learning inference
Language:Python 6
domenicostefani / deep-classf-runtime-wrappers
Classification wrappers for 4 Deep Learning Embedded Runtimes for Music Information Retrieval, plus utilities to convert a TensorFlow Model
wrappers classification deep-learning tensorflow-lite rtneural torchscript onnx-runtime mir music-information-retrieval
Language:C++ 6
HoangHPham / Table-Detection-From-YOLOv7-to-Flask
A Flask app that detects table using ONNX model exported from YOLOv7
flask flask-application object-detection onnx onnx-runtime table-detection yolov7
Language:Python 4
CartesianXR7 / scout-vision
Real-time computer vision for embedded Rust with OpenCV and YOLOv8 built with resource-constrained devices such as the Raspberry Pi Zero 2W in mind.
computer-vision embedded onnx opencv pathfinding raspberry-pi-zero-2-w robotics rust yolov8 ffi-bindings inference neural-networks onnx-runtime opencv-rust
Language:Makefile 3
pranta-barua007 / yolo11s-seg-web-onnx
onnx-runtime yolo11-detection onnxruntime-web
Language:TypeScript 3
ZygoteCode / RmbgSharp
Enterprise-unique blazing-fast & precise C# .NET 9.0 library for background removal in C# using ONNX Runtime with DirectML. FP32 and FP16 versions! Always open for PRs.
background-removal background-remover csharp dotnet image-editing image-processing onnx onnx-runtime onnxruntime remove-background remove-background-image rmbg
Language:C# 3

onnx-runtime

snakers4 / silero-vad

royshil / obs-backgroundremoval

StarlightSearch / EmbedAnything

NickSwardh / YoloDotNet

dme-compunet / YoloSharp

jobergum / browser-ml-inference

nbigaouette / onnxruntime-rs

FaceONNX / FaceONNX

triton-inference-server / onnxruntime_backend

Shannon-Data / ShannonBase

Yulv-git / Model-Inference-Deployment

emptysoal / tensorrt-experiment

COO1M / SRMaster

ms-iot / ros_msft_onnx

LIU42 / FlowerClassify

zz990099 / EasyDeploy

josephrocca / super-resolution-js

PT-Perkasa-Pilar-Utama / ppu-yolo-onnx-inference

dineshsoudagar / local-llms-on-android

itlab-vision / dl-benchmark

chinoll / deepdanbooru_onnx

renesas-rz / meta-renesas-ai

Mobile-Artificial-Intelligence / babylon.cpp

mtszkw / fast-torch

instant-high / deoldify-onnx

jonathanpeppers / inclusive-code-reviews-ml

Ave-Sergeev / Dictator

kaiidams / Voice100AndroidApp

BinhMinhs10 / transformers_onnx

HighPoint / aws-lambda-onnx-model

ashrafgt / onnx-keras-example

domenicostefani / deep-classf-runtime-wrappers

HoangHPham / Table-Detection-From-YOLOv7-to-Flask

CartesianXR7 / scout-vision

pranta-barua007 / yolo11s-seg-web-onnx

ZygoteCode / RmbgSharp