onnxruntime

There are 7 repositories under onnxruntime topic.

niedev / RTranslator
Open source real-time translation app for Android that runs locally
translator bluetooth-le realtime-translator android-app onnx onnxruntime sentencepiece transformers translation nllb whisper mobile-app android offline
Language:C++ 9330
snakers4 / silero-vad
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
onnx onnx-runtime onnxruntime pytorch speech speech-processing vad voice-activity-detection voice-commands voice-control voice-detection voice-recognition
Language:Python 7279
CVHub520 / X-AnyLabeling
Effortless data labeling with AI support from Segment Anything and other awesome models.
artificial-intelligence clip computer-vision deep-learning groundingdino image-annotation-tool image-classification image-labeling-tool image-matting instance-segmentation machine-learning object-detection ocr onnxruntime paddlepaddle pose-estimation rotated-object-detection sam vision-language-model yolo
Language:Python 6908
RapidAI / RapidOCR
📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.
chineseocr crnn dbnet easyocr ocr onnxocr onnxruntime openvino paddleocr rapidocr rapidocronnxruntime
Language:Python 5222
djl
deepjavalibrary / djl
An Engine-Agnostic Deep Learning Framework in Java
ai autograd deep-learning deep-neural-networks djl java machine-learning ml mxnet neural-network onnxruntime pytorch tensorflow
Language:Java 4683
xlite-dev / lite.ai.toolkit
🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
yolox onnxruntime robustvideomatting mnn ncnn tnn yolov6 onnx yolov5 yolov8 tensorrt mnn-model facefusion stable-diffusion
Language:C++ 4285
remsky / Kokoro-FastAPI
Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching
fastapi huggingface-spaces kokoro kokoro-tts onnx onnxruntime openai-compatible-api openwebui pytorch sillytavern tts tts-api uv
Language:Python 3914
royshil / obs-backgroundremoval
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
obs obs-plugin libobs mac-osx background-segmentation obs-studio onnx onnxruntime plugin computer-vision image-segmentation obs-studio-plugin obsproject onnx-runtime onnxruntime-gpu video-segmentation
Language:C++ 3892
huggingface / optimum
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
graphcore habana inference intel onnx onnxruntime optimization pytorch quantization tflite training transformers
Language:Python 3161
open-mmlab / mmdeploy
OpenMMLab Model Deployment Framework
model-converter sdk deployment tensorrt ncnn pplnn openvino onnxruntime onnx mmdetection mmsegmentation computer-vision deep-learning pytorch
Language:Python 3060
janhq / cortex.cpp
Local AI API Platform
gguf llamacpp onnx onnxruntime
Language:C++ 2761
Djdefrag / QualityScaler
QualityScaler - image/video AI upscaler app
amd anime compression-artifact-reduction deep-learning directx-12 gui-application intel manga noise-reduction nvidia onnx onnxruntime opencv python python3 pytorch super-resolution video video-processing windows
Language:Python 2623
ppogg / YOLOv5-Lite
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
ncnn yolov5 android-app mnn shufflenetv2 repvgg transformer tensorrt pplcnet openvivo mobilenet tflite pytorch picodet onnxruntime
Language:C++ 2445
thewh1teagle / kokoro-onnx
TTS with kokoro and onnx runtime
kokoro onnxruntime python tts
Language:Python 2254
notAI-tech / NudeNet
Lightweight nudity detection
censorship javascript keras machinelearning nsfw nsfw-data nsfw-recognition nudity nudity-detection nudity-detector object-detection onnxruntime
Language:Python 2185
emilianavt / OpenSeeFace
Robust realtime face and facial landmark tracking on CPU with Unity integration
face-tracking face-landmarks depth-estimation unity unity3d python csharp udp onnx onnxruntime virtual-youtuber vtuber mobilenetv3 pytorch openseeface face-detection detection-model landmark-model tracker cpu
Language:Python 1740
pykeio / ort
Fast ML inference & training for ONNX models in Rust
ai ai-training fine-tuning inference machine-learning onnx onnxruntime rust
Language:Rust 1689
ricky0123 / vad
Voice activity detector (VAD) for the browser with a simple API
onnxruntime silero-vad speech-to-text typescript voice-activity-detection web web-audio-api
Language:TypeScript 1670
lemonade-sdk / lemonade
Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
ai amd genai gpu llama llm llm-inference llms local-server mcp mcp-server mistral npu onnxruntime openai-api qwen radeon ryzen vulkan
Language:Python 1579
nndeploy / nndeploy
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
ai ascend deep-learning deployment diffusers genai llm low-code low-code-platform mnn no-code onnxruntime openvino python pytorch tensorrt transformer workflow
Language:C++ 1429
head-pose-estimation
yinguobing / head-pose-estimation
Realtime human head pose estimation with ONNXRuntime and OpenCV.
convolutional-neural-networks deep-learning facial-landmarks-detection onnxruntime opencv tensorflow
Language:Python 1320
ai-dev-gallery
microsoft / ai-dev-gallery
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
directml dotnet genai npu onnx phi3 qnn stable-diffusion windows winui3 ai onnxruntime onnxruntime-genai visual-studio winappsdk developer-tools mistral whisper wpf csharp
Language:C# 1259
pur1fying / blue_archive_auto_script
支持按轴凹总力战, 无缝制造三解, 用于实现蔚蓝档案自动化的程序( Steam已适配 )
gui python automation bluearchive onnxruntime opencv total-assault ultralytics yolov8
Language:Python 1199
PriesiaMioShirakana / DragonianVoice
多个SVC/TTS的C++推理库
pytorch hifigan onnxruntime tacotron2 tts vits sovits diffsvc diffsinger rvc bertvits2 reflowsvc
Language:C 1099
PaddlePaddle / Paddle2ONNX
ONNX Model Exporter for PaddlePaddle
paddlepaddle ocr deploy onnx detection classification ppocr picodet ppyoloe onnxruntime
Language:C++ 867
RedisAI / redis-inference-optimization
A Redis module for serving tensors and executing deep learning graphs
machine-learning onnxruntime pytorch redisai serving-tensors tensorflow
Language:C 839
StarlightSearch / EmbedAnything
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
embedding-models large-language-models machine-learning indexing rag rust rust-lang information-retrieval vision-language-model ingestion vector-database high-performance inference python vector-search production hybrid onnx-runtime onnxruntime server
Language:Rust 762
rnchg / APT
AI Productivity Tool - Free and open source, improve user productivity, and protect privacy and data security. Including but not limited to: built-in local exclusive ChatGPT, DeepSeek, Phi, Qwen and other models, one-click batch intelligent processing of pictures, videos, audio, etc.
ai ai-framework aigc audio-processing chatgpt computer-vision deep-learning deepseek generative-ai image-processing inference llm machine-learning machinelearning neural-network onnx onnxruntime video-processing
Language:C# 761
yolort
zhiqwang / yolort
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
libtorch yolov5 inference torchscript onnx onnxruntime tvm pytorch detection jit visualization yolo lightning yolort deployment ncnn tensorrt graghsurgeon trt nms
Language:Python 731
fastT5
Ki6an / fastT5
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
python t5 onnx onnxruntime quantization fastt5 nlp fast quantized-onnx-models translation question-answering inference-speed pytorch inference deep-learning transformer
Language:Python 587
xaviviro / refacer
Refacer: One-Click Deepfake Multi-Face Swap Tool
ai deepfake deepfakes face-swap face-swapping onnx onnxruntime refacer
Language:Python 567
stochasticai / x-stable-diffusion
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
aitemplate automl cuda docker inference notebook nvfuser onnx onnxruntime pytorch stable-diffusion tensorrt
Language:Jupyter Notebook 559
Kazuhito00 / Image-Processing-Node-Editor
処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)
dearpygui node-editor onnx onnxruntime opencv image-processing-node-editor
Language:Python 550
LightGlue-ONNX
fabio-sim / LightGlue-ONNX
ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO
deep-learning feature-extraction feature-matching homography homography-estimation local-feature-matching local-features machine-learning onnx onnx-torch onnxruntime pytorch visual-localization pose-estimation tensorrt openvino disk lightglue superpoint
Language:Python 540
ibaiGorordo / ONNX-YOLOv8-Object-Detection
Python scripts performing object detection using the YOLOv8 model in ONNX.
yolov8 onnx onnxruntime opencv python computer-vision deep-learning object-detection yolo
Language:Python 465
yalue / onnxruntime_go
A Go (golang) library wrapping microsoft/onnxruntime.
arm64 go golang linux neural-networks onnx onnxruntime windows
Language:Go 419