openvino

There are 33 repositories under openvino topic.

llmware-ai / llmware
Unified framework for building enterprise RAG pipelines with small, specialized models
agents generative-ai-tools llamacpp llm onnx openvino parsing retrieval-augmented-generation small-specialized-models
Language:Python 14444
YOLOX
Megvii-BaseDetection / YOLOX
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
deep-learning megengine ncnn object-detection onnx openvino pytorch tensorrt yolo yolov3 yolox
Language:Python 10154
openvinotoolkit / openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
inference deep-learning openvino ai computer-vision diffusion-models generative-ai llm-inference natural-language-processing nlp performance-boost speech-recognition stable-diffusion deploy-ai optimize-ai transformers yolo recommendation-system good-first-issue
Language:C++ 9181
hybridgroup / gocv
Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, OpenCV Contrib, and OpenVINO.
opencv golang video computer-vision video-capture face-tracking mjpeg mjpeg-stream image-processing tensorflow computervision openvino dnn gocv object-tracking object-classification cuda onnx yolo
Language:Go 7273
RangiLyu / nanodet
NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥
anchor-free android deep-learning deep-neural-networks efficientnet mnn model-zoo nanodet nanodet-plus ncnn object-detection openvino pytorch repvgg shufflenet
Language:Python 6093
RapidAI / RapidOCR
📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.
chineseocr crnn dbnet easyocr ocr onnxocr onnxruntime openvino paddleocr rapidocr rapidocronnxruntime
Language:Python 5222
open-edge-platform / anomalib
An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.
anomaly-localization anomaly-segmentation anomaly-detection unsupervised-learning neural-network-compression openvino geti
Language:Python 5107
Tencent / TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
deep-learning mnn ncnn inference pytorch tensorflow coreml tensorrt tengine openvino face-detection hairsegmentaion ocr
Language:C++ 4590
openvinotoolkit / open_model_zoo
Pre-trained Deep Learning models and demos (high quality and extremely fast)
models caffemodel demo tensorflow-models model-zoo model deep-learning-models cnn-model openvino inference onnx-models pytorch-models openvino-model-zoo openvino-models openvino-toolkit
Language:Python 4310
PINTO_model_zoo
PINTO0309 / PINTO_model_zoo
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
tensorflow tensorflow-lite openvino edgetpu mediapipe coreml tensorflowjs tf-trt onnx pytorch tflite tfjs model-zoo models keras computer-vision caffe pretrained-models model tflite-models
Language:Python 3967
collabora / WhisperLive
A nearly-live implementation of OpenAI's Whisper.
dictation obs openai openvino openvino-intel tensorrt tensorrt-llm text-to-speech translation voice-recognition whisper whisper-tensorrt
Language:Python 3550
open-mmlab / mmdeploy
OpenMMLab Model Deployment Framework
model-converter sdk deployment tensorrt ncnn pplnn openvino onnxruntime onnx mmdetection mmsegmentation computer-vision deep-learning pytorch
Language:Python 3060
openvino_notebooks
openvinotoolkit / openvino_notebooks
📚 Jupyter notebook tutorials for OpenVINO™
computer-vision deep-learning inference machine-learning openvino
Language:Jupyter Notebook 2938
Daniil-Osokin / lightweight-human-pose-estimation.pytorch
Fast and accurate human pose estimation in PyTorch. Contains implementation of "Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose" paper.
coco-keypoints-detection deep-learning human-pose-estimation lightweight lightweight-openpose mscoco-keypoint openpose openvino pose-estimation pytorch real-time
Language:Python 2214
rupeshs / fastsdcpu
Fast stable diffusion on CPU and AI PC
aipc api cli cpu desktopgui diffusers diffusion fastsdcpu flux gradio latentconsistencymodels lcmdiffusion openvino qt sdupcale sdxlturbo sdxs stablediffusion torch webui
Language:Python 1822
DT42 / BerryNet
Deep learning gateway on Raspberry Pi and other edge devices
raspberry-pi deep-learning tensorflow iot mqtt aiot edge-devices edge-ai openvino tensorrt edge-computing
Language:Python 1616
CoinCheung / BiSeNet
Add bisenetv2. My implementation of BiSeNet
bisenet cityscapes pytorch cocostuff tensorrt ncnn openvino triton-inference-server ade20k
Language:Python 1574
open-edge-platform / training_extensions
Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™
openvino computer-vision deep-learning pytorch neural-networks-compression quantization hyper-parameter-optimization image-classification image-segmentation object-detection self-supervised-learning semi-supervised-learning transfer-learning action-recognition anomaly-detection datumaro automl machine-learning incremental-learning geti
Language:Python 1203
openvinotoolkit / nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
bert classification compression deep-learning genai llm mixed-precision-training nlp object-detection onnx openvino pruning pytorch quantization quantization-aware-training semantic-segmentation sparsity tensorflow transformers
Language:Python 1091
movidius / ncappzoo
Contains examples for the Movidius Neural Compute Stick.
ai cpp intel-movidius-ncs opencv openvino python usb-accelerator
Language:Python 959
cunjian / pytorch_face_landmark
Fast and accurate face landmark detection library using PyTorch; Support 68-point semi-frontal and 39-point profile landmark detection; Support both coordinate-based and heatmap-based inference; Up to 100 FPS landmark inference speed with SOTA face detector on CPU.
face-alignment face-landmark-detection onnx pytorch-face-landmark openvino
Language:Python 902
Adlik / Adlik
Adlik: Toolkit for Accelerating Deep Learning Inference
deep-learning inference tensorflow-serving openvino tensorrt compiler inference-engine model-optimizer docker-images
Language:C++ 806
openvinotoolkit / model_server
A scalable inference server for models optimized with OpenVINO™
openvino inference ai edge cloud deep-learning serving dag kubernetes machine-learning model-serving genai
Language:C++ 787
jizhishutong / YOLOU
YOLOv3、YOLOv4、YOLOv5、YOLOv5-Lite、YOLOv6-v1、YOLOv6-v2、YOLOv7、YOLOX、YOLOX-Lite、PP-YOLOE、PP-PicoDet-Plus、YOLO-Fastest v2、FastestDet、YOLOv5-SPD、TensorRT、NCNN、Tengine、OpenVINO
yolo ncnn openvino tensorrt tengine yolov5 yolov6 yoloe
Language:Jupyter Notebook 762
bes-dev / MobileStyleGAN.pytorch
An official implementation of MobileStyleGAN in PyTorch
stylegan2 stylegan2-pytorch openvino sylegan gan mobile-development image-synthesis
Language:Python 695
DoubangoTelecom / ultimateALPR-SDK
World's fastest ANPR / ALPR implementation for CPUs, GPUs, VPUs and NPUs using deep learning (Tensorflow, Tensorflow lite, TensorRT, OpenVX, OpenVINO). Multi-Charset (Latin, Korean, Chinese) & Multi-OS (Jetson, Android, Raspberry Pi, Linux, Windows) & Multi-Arch (ARM, x86).
artificial-intelligence alpr anpr anpr-sdk machine-learning deep-learning license-plate license-plate-recognition license-plate-detection raspberry-pi android linux windows openvino tensorflow jetson jetson-nano khadas-vims-boards amlogic-npu khadas-vim3
Language:C++ 695
Daniil-Osokin / lightweight-human-pose-estimation-3d-demo.pytorch
Real-time 3D multi-person pose estimation demo in PyTorch. OpenVINO backend can be used for fast inference on CPU.
3d-human-pose cmu-panoptic computer-vision deep-learning human-pose-estimation keypoint-estimation lightweight multi-person-pose-estimation openvino pytorch real-time
Language:Python 683
dlstreamer / dlstreamer
DL Streamer is now part of Open Edge Platform, for latest updates and releases please visit new repo: https://github.com/open-edge-platform/edge-ai-libraries/tree/main/libraries/dl-streamer
gstreamer gstreamer-plugins inference intel openvino
Language:C++ 563
LightGlue-ONNX
fabio-sim / LightGlue-ONNX
ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO
deep-learning feature-extraction feature-matching homography homography-estimation local-feature-matching local-features machine-learning onnx onnx-torch onnxruntime pytorch visual-localization pose-estimation tensorrt openvino disk lightglue superpoint
Language:Python 540
PINTO0309 / OpenVINO-YoloV3
YoloV3/tiny-YoloV3+RaspberryPi3/Ubuntu LaptopPC+NCS/NCS2+USB Camera+Python+OpenVINO
openvino yolov3 deep-learning deeplearning object-detection python opencv tensorflow cpu ncs
Language:Python 536
huggingface / optimum-intel
🤗 Optimum Intel: Accelerate inference with Intel optimization tools
diffusers distillation inference intel onnx openvino optimization pruning quantization transformers
Language:Jupyter Notebook 505
AmusementClub / vs-mlrt
Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)
vapoursynth deep-learning neural-network artificial-intelligence onnx tensorrt openvino onnxruntime waifu2x dpir real-esrgan real-cugan cuda gpu vulkan ncnn rife directml migraphx
Language:C++ 385
open-edge-platform / geti
Build computer vision models in a fraction of the time and with less data.
computer-vision deep-learning fine-tuning inference openvino geti
Language:TypeScript 383
PINTO0309 / MobileNet-SSD-RealSense
[High Performance / MAX 30 FPS] RaspberryPi3(RaspberryPi/Raspbian Stretch) or Ubuntu + Multi Neural Compute Stick(NCS/NCS2) + RealSense D435(or USB Camera or PiCamera) + MobileNet-SSD(MobileNetSSD) + Background Multi-transparent(Simple multi-class segmentation) + FaceDetection + MultiGraph + MultiProcessing + MultiClustering
raspberry-pi mobilenet-ssd realsense neural-compute-stick python raspberrypi d435 caffe usbcamera mobilenetssd movidus deeplearning opencv ssdmobilenet ubuntu raspbian facedetection multiprocessing openvino
Language:Python 370
openvino2tensorflow
PINTO0309 / openvino2tensorflow
This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and pb. PyTorch (NCHW) -> ONNX (NCHW) -> OpenVINO (NCHW) -> openvino2tensorflow -> Tensorflow/Keras (NHWC/NCHW) -> TFLite (NHWC/NCHW). And the conversion from .pb to saved_model and from saved_model to .pb and from .pb to .tflite and saved_model to .tflite and saved_model to onnx. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support.
caffe converter coreml docker edgetpu keras models-converter mxnet onnx openvino pytorch tensorflow tensorflow-lite tensorflowjs tensorrt tf-trt tfjs tflite
Language:Python 343
huggingface / optimum-benchmark
🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
benchmark neural-compressor onnxruntime openvino pytorch tensorrt-llm text-generation-inference
Language:Python 317

openvino

llmware-ai / llmware

Megvii-BaseDetection / YOLOX

openvinotoolkit / openvino

hybridgroup / gocv

RangiLyu / nanodet

RapidAI / RapidOCR

open-edge-platform / anomalib

Tencent / TNN

openvinotoolkit / open_model_zoo

PINTO0309 / PINTO_model_zoo

collabora / WhisperLive

open-mmlab / mmdeploy

openvinotoolkit / openvino_notebooks

Daniil-Osokin / lightweight-human-pose-estimation.pytorch

rupeshs / fastsdcpu

DT42 / BerryNet

CoinCheung / BiSeNet

open-edge-platform / training_extensions

openvinotoolkit / nncf

movidius / ncappzoo

cunjian / pytorch_face_landmark

Adlik / Adlik

openvinotoolkit / model_server

jizhishutong / YOLOU

bes-dev / MobileStyleGAN.pytorch

DoubangoTelecom / ultimateALPR-SDK

Daniil-Osokin / lightweight-human-pose-estimation-3d-demo.pytorch

dlstreamer / dlstreamer

fabio-sim / LightGlue-ONNX

PINTO0309 / OpenVINO-YoloV3

huggingface / optimum-intel

AmusementClub / vs-mlrt

open-edge-platform / geti

PINTO0309 / MobileNet-SSD-RealSense

PINTO0309 / openvino2tensorflow

huggingface / optimum-benchmark