onnxruntime

There are 4 repositories under onnxruntime topic.

djl
deepjavalibrary / djl
An Engine-Agnostic Deep Learning Framework in Java
deep-learning neural-network ai java mxnet machine-learning deep-neural-networks ml autograd djl pytorch tensorflow onnxruntime
Language:Java 3883
DefTruth / lite.ai.toolkit
🛠 A lite C++ toolkit of awesome AI models, support ONNXRuntime, MNN. Contains YOLOv5, YOLOv6, YOLOX, YOLOR, FaceDet, HeadSeg, HeadPose, Matting etc. Engine: ONNXRuntime, MNN.
yolox retinaface onnxruntime segmentation yolor yolop nanodet robustvideomatting mnn ncnn tnn modnet scrfd yolox-nano yolox-tiny yolov6 yolov7 onnx yolov5 yolov8
Language:C++ 3458
PaddlePaddle / FastDeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
android jetson tensorrt onnxruntime object-detection yolov5 openvino picodet uie graphcore intel kunlun rockchip serving onnx stable-diffusion yolov8
Language:C++ 2741
occ-ai / obs-backgroundremoval
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
obs obs-plugin libobs mac-osx background-segmentation obs-studio onnx onnxruntime plugin
Language:C++ 2551
open-mmlab / mmdeploy
OpenMMLab Model Deployment Framework
model-converter sdk deployment tensorrt ncnn pplnn openvino onnxruntime onnx mmdetection mmsegmentation computer-vision deep-learning pytorch
Language:Python 2545
huggingface / optimum
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
onnx pytorch inference training intel graphcore onnxruntime transformers quantization habana optimization tflite
Language:Python 2190
ppogg / YOLOv5-Lite
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
ncnn yolov5 android-app mnn shufflenetv2 repvgg transformer tensorrt pplcnet openvivo mobilenet tflite pytorch picodet onnxruntime
Language:C++ 2122
RapidAI / RapidOCR
Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle.
chineseocr crnn dbnet easyocr ocr onnxruntime openvino paddleocr rapidocr
Language:Python 2058
notAI-tech / NudeNet
Lightweight nudity detection
nsfw-recognition censorship object-detection keras nsfw-data machinelearning nudity-detection nudity-detector nudity javascript nsfw onnxruntime
Language:Python 1607
hcaptcha-challenger
QIN2DIM / hcaptcha-challenger
🥂 Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.
yolov5 hcaptcha opencv-python onnx-models hcaptcha-solver solver onnx yolo onnxruntime playwright clip multi-modal zero-shot-classification multi-modal-learning computer-vision image-segmentation object-detection
Language:Python 1422
emilianavt / OpenSeeFace
Robust realtime face and facial landmark tracking on CPU with Unity integration
face-tracking face-landmarks depth-estimation unity unity3d python csharp udp onnx onnxruntime virtual-youtuber vtuber mobilenetv3 pytorch openseeface face-detection detection-model landmark-model tracker cpu
Language:Python 1327
head-pose-estimation
yinguobing / head-pose-estimation
Realtime human head pose estimation with ONNXRuntime and OpenCV.
convolutional-neural-networks deep-learning facial-landmarks-detection onnxruntime opencv tensorflow
Language:Python 1157
NaruseMioShirakana / MoeVoiceStudio
一个使用C++编写的音频处理软件
pytorch hifigan onnxruntime tacotron2 tts vits sovits diffsvc diffsinger
Language:C 927
RedisAI / RedisAI
A Redis module for serving tensors and executing deep learning graphs
redisai pytorch tensorflow onnxruntime serving-tensors machine-learning
Language:C 815
yolort
zhiqwang / yolort
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
deployment detection graghsurgeon inference jit libtorch lightning ncnn nms onnx onnxruntime pytorch tensorrt torchscript trt tvm visualization yolo yolort yolov5
Language:Python 705
PaddlePaddle / Paddle2ONNX
ONNX Model Exporter for PaddlePaddle
paddlepaddle ocr deploy onnx detection classification ppocr picodet ppyoloe onnxruntime
Language:Python 656
pykeio / ort
A Rust wrapper for ONNX Runtime
ai inference machine-learning onnx onnxruntime rust wasm webassembly
Language:Rust 593
stochasticai / x-stable-diffusion
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
inference pytorch stable-diffusion tensorrt aitemplate nvfuser cuda onnx onnxruntime notebook automl docker
Language:Jupyter Notebook 547
fastT5
Ki6an / fastT5
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
python t5 onnx onnxruntime quantization fastt5 nlp fast quantized-onnx-models translation question-answering inference-speed pytorch inference deep-learning transformer
Language:Python 541
xaviviro / refacer
Refacer: One-Click Deepfake Multi-Face Swap Tool
ai deepfake deepfakes face-swap face-swapping onnx onnxruntime refacer
Language:Python 493
Kazuhito00 / Image-Processing-Node-Editor
処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)
dearpygui node-editor onnx onnxruntime opencv image-processing-node-editor
Language:Python 441
ibaiGorordo / ONNX-YOLOv8-Object-Detection
Python scripts performing object detection using the YOLOv8 model in ONNX.
yolov8 onnx onnxruntime opencv python computer-vision deep-learning object-detection yolo
Language:Python 326
tpoisonooo / llama.onnx
LLaMa/RWKV onnx models, quantization and testcase
alpaca llama llm onnx onnxruntime quantization transformer rwkv
Language:Python 325
azkadev / ntts
Neural Text To Speech Di Dart Cepat Ringan Tanpa Koneksi Internet dan bisa berjalan di cpu
android dart flutter ios linux macos ntts text-to-speech tts web windows natural-text-to-speech ai home-assistant indonesia ml speech-synthesis cpu scifi onnxruntime
Language:C++ 289
azkadev / onnx
ONNX DART LIBRARY
ai dart deep-learning ml onnx onnxruntime artificial-intelligence libraries library machine-learning flutter inference
Language:C++ 286
xmba15 / onnx_runtime_cpp
small c++ library to quickly deploy models using onnxruntime
onnx onnxruntime onnx-cpp cpp tiny-yolov2 mask-rcnn mask-rcnn-cpp yolov3 face-detection yolox object-detection deep-learning paddlepaddle paddleseg paddleseg-onnx superpoint superglue loftr
Language:C++ 286
LightGlue-ONNX
fabio-sim / LightGlue-ONNX
ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO
deep-learning feature-extraction feature-matching homography homography-estimation local-feature-matching local-features machine-learning onnx onnx-torch onnxruntime pytorch visual-localization pose-estimation tensorrt openvino disk lightglue superpoint
Language:Python 272
nbigaouette / onnxruntime-rs
Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
onnxruntime onnx rust onnx-runtime onnxruntime-sys inference rust-wrapper
Language:Rust 261
axodox / unpaint
A simple Windows / Xbox app for generating AI images with Stable Diffusion.
ai cpp image-generation inpaint native onnx onnxruntime stable-diffusion uwp windows winui directml
Language:C++ 260
onnxt5
abelriboulot / onnxt5
Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
nlp nlp-machine-learning onnx onnxruntime transformer transformers inference summarization translation text-generation text-classification sentiment-analysis
Language:Python 245
AmusementClub / vs-mlrt
Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!)
artificial-intelligence cuda deep-learning directml dpir gpu migraphx ncnn neural-network onnx onnxruntime openvino real-cugan real-esrgan rife tensorrt vapoursynth vulkan waifu2x
Language:C++ 236
Ar-Ray-code / YOLOX-ROS
YOLOX + ROS2 object detection package (C++ only support)
yolox object-detection opencv deep-learning ros2 openvino ros tensorrt onnxruntime tflite humble
Language:C++ 235
hpc203 / yolov5-v6.1-opencv-onnxrun
分别使用OpenCV、ONNXRuntime部署yolov5-v6.1目标检测，包含C++和Python两个版本的程序。支持yolov5s，yolov5m，yolov5l，yolov5n，yolov5x，yolov5s6，yolov5m6，yolov5l6，yolov5n6，yolov5x6的十种结构的yolov5-v6.1
opencv-dnn onnxruntime cpp python yolov5
Language:C++ 227
RapidAI / RapidLaTeXOCR
Formula recognition based on LaTeX-OCR and ONNXRuntime.
equation latex-ocr ocr im2text image-processing latex math-ocr onnxruntime python img2latex math-formula math-formula-recognition
Language:Python 225
itsnine / yolov5-onnxruntime
YOLOv5 ONNX Runtime C++ inference code.
onnxruntime yolov5 onnx opencv object-detection deployment
Language:C++ 213
cassiebreviu / StableDiffusion
Inference Stable Diffusion with C# and ONNX Runtime
csharp onnx onnxruntime stable-diffusion
Language:C# 208