openvinotoolkit / awesome-openvino

A curated list of OpenVINO based AI projects

Awesome OpenVINO

A curated list of OpenVINO based AI projects. The most exciting community projects based on OpenVINO are highlighted here. Explore a rich assortment of OpenVINO-based projects, libraries, and tutorials that cover a wide range of topics, from model optimization and deployment to real-world applications in various industries.

This repository is a collaborative effort, continuously updated to provide you with the latest and most valuable resources for maximizing the potential of OpenVINO in your projects. If you want your project to appear in this list, please create a Pull Request or contact @DimaPastushenkov. Inspired by Awesome oneAPI

If your project is featured in this Awesome OpenVINO list, you are welcome to use the 'Mentioned in Awesome' badge on your project's repository.

What is OpenVINO

OpenVINO™ is an open-source toolkit for AI inference optimization and deployment.

• Enhances deep learning performance in computer vision, automatic speech recognition, natural language processing, and other common tasks.
• Utilize models trained with popular frameworks such as TensorFlow and PyTorch while efficiently reducing resource demands.
• Deploy seamlessly across a spectrum of Intel® platforms, spanning from edge to cloud.

Further resources:

• OpenVINO GitHub repo.

• To download OpenVINO toolkit, go here.

• A collection of ready-to-run Jupyter notebooks for learning and experimenting with the OpenVINO™ toolkit- OpenVINO Notebooks.

Table of content

1. Generative AI
2. AI Computer Vision
3. AI Audio
4. OpenVINO API extentions
5. Natural Language Processing
6. Multimodal projects
7. Miscellaneous
8. Educational

Generative AI

• Stable Diffusion web UI - This is a repository for a browser interface based on Gradio library for Stable Diffusion
• stable_diffusion.openvino - This GitHub project provides an implementation of text-to-image generation using stable diffusion on Intel CPU or GPU. It requires Python 3.9.0 and is compatible with OpenVINO.
• Fast SD - FastSD CPU is a faster version of Stable Diffusion on CPU. Based on Latent Consistency Models and Adversarial Diffusion Distillation.Read blog post about Fast Stable Diffusion on CPU using FastSD and OpenVINO.
• OpenVINO™ AI Plugins for GIMP - Provides a set of OpenVINO based plugins that add AI features to GIMP (GNU IMAGE MANIPULATION PROGRAM)
• OpenVINO Code - VSCode extension for AI code completion with OpenVINO - VSCode extension for helping developers writing code with AI code assistant.
• Enhancing Customer Service with Real-Time Sentiment Analysis: Leveraging LLMs and OpenVINO for Instant Emotional Insights - The integration of LLMs with sentiment analysis models, further optimised by OpenVINO.
• OV_SD_CPP - The pure C++ text-to-image pipeline, driven by the OpenVINO native API for Stable Diffusion v1.5 with LMS Discrete Scheduler.
• QuickStyle - A simple stylizing app utilizing OpenVINO to stylize common objects in images.
• QuickPainter - A simple inpainting app utilizing OpenVINO to remove common objects from images.
• BlurAnything - An adaptation of the excellent Track Anything project which is in turn based on Meta's Segment Anything and XMem.
• Stable Diffusion 2.1 on Intel ARC - A simple and easy-to-use demo to run Stable Diffusion 2.1 for Intel ARC graphics card based on OpenVINO.
• AI Video Builder - Make videos with AI images from YouTube videos.

AI Computer Vision

• BMW-IntelOpenVINO-Detection-Inference-API - This is a repository for an object detection inference API using OpenVINO, supporting both Windows and Linux operating systems
• yolov5_export_cpu - The project provides documentation on exporting YOLOv5 models for fast CPU inference using Intel's OpenVINO framework
• LidarObjectDetection-PointPillars (C++ based, requires AI toolkit and OpenVINO). demonstrates how to perform 3D object detection and classification using input data (point cloud) from a LIDAR sensor.
• Image Processing with OpenVINO
• Implementing GAN with OpenVINO
• RapidOCR
• Pedestrian fall detection - Pedestrian fall detection. Deploying PP-Human based on OpenVINO C # API
• OpenVINO Tennis Posture - Deciphering Tennis Posture with Artificial Intelligence
• Cigarette Detection - The project begins by YOLOv8-pose detecting human body positions and extracting skeletal information from images. Based on the skeletal poses, it assesses the elbow angles and the distance between hands and mouths for each individual. If successful, the RTDETR model is employed to detect cigarettes at the mouth zone.
• FastSAM_Awesome_OpenVINO - The Fast Segment Anything Model(FastSAM) is a CNN Segment Anything Model trained by only 2% of the SA-1B dataset published by SAM authors. The FastSAM achieve a comparable performance with the SAM method at 50× higher run-time speed.
• Computer Vision Models As Service - implements different Computer Vision Deep Learning Models as a service.
• Dance-with: Dance with your friends with the right pose! - Dance-with corrects your dance posture using multi-person OpenPose, 2D pose estimation Deep Learning model.
• Target-Person-Tracking-System - Integration of face recognition and person tracking.
• Metin2 Bot - bots for video game Metin2.
• Machine control - industrial machine surveillance system designed to help increase efficiency of processes.
• MeetingCam - Run your AI and CV algorithms in online meetings such as Zoom, Meets or Teams!
• Virtual-Tryon - Use AI to try on clothes with your pictures.
• DepthAI Experiments - A collections of projects done with DepthAI.
• Project Babble - Mouth tracking project designed to work with any existing VR headset.
• Group Pose - A Simple Baseline for End-to-End Multi-person Pose Estimation.
• Frigate - NVR With Realtime Object Detection for IP Cameras.
• CGD OpenVINO Demo - Efficient Inference and Quantization of CGD for Image Retrieval.
• Risk package detection - Threat Detection and Unattended Baggage Detection with Associated Person Tracking.
• YOLOv7-Intel - Object Detection For Autonomous Vehicles.
• Cerberus - Dog Breed Classification and Body Localization.
• Criminal Activity recognition - Criminal Activity Video Surveillance.
• RapidOCR on OpenVINO GPU - A modified verison of RapidOCR to support OpenVINO GPU.

AI Audio

• Whisper OpenVINO

OpenVINO API extentions

• OpenVINO™ C# API
• OpenVINO Java API
• OpenVINO LabVIEW API
• OpenVINO.net
• OpenVINO-rs
• OpenVINO-GO Client - The end goal is to utilize a Go client to facilitate user-friendly batch processing of molecular data, interfacing with a Flask server that employs OpenVINO for optimized lipophilicity predictions and molecular visualization

Natural Language Processing

• Japanese chatbot Youri - LLM Japanese chatbot demo program using Intel OpenVINO toolkit.
• OpenVINO GPT-Neo - a port of GPT-Neo that uses OpenVINO.
• Resume-Based Interview Preparation Tool - The Resume-Based Interview Preparation Tool is a software application designed to streamline the interview process by helping interviewers generate relevant and meaningful questions based on a candidate's resume or portfolio page.

Multimodal projects

• Scene Explorer for kids - Integration of a chat bot with an object detection algorithm.
• Indoor Care Chatbot - An Elderly Indoor Care Chatbot with an object detection algorithm.
• SA2 - Vision-Oriented MultiModal AI.

openSUSE

• OpenVINO Support This initiative generated openVINO compatibility with the openSUSE Linux platform. Because dependencies were added to tools and libraries for software development using C/C++ and other compilation directives for the programming language.

Educational

• NTUST Edge AI 2023 Artificial Intelligence and Edge Computing Practice - Educational meterials about AI and Edge Computing Practice GNU IMAGE MANIPULATION PROGRAM

Miscellaneous

• JAX: Artificial Intelligence for everyone. - JAX (Just an Artificial Intelligence Extended) is an optimized version of the openSUSE Linux image to work with openVINO. This platform was designed to facilitate the access and development of AI applications.
• Shared Memory for AI inference - Shared memory interface between OpenVINO and CODESYS. It allows to exchange variable between Control Application, written in IEC and OpenVINO Application, which performs inference
• webnn-native- WebNN Native is an implementation of the Web Neural Network API, providing building blocks, headers, and backends for ML platforms including DirectML, OpenVINO, and XNNPACK.
• NVIDIA GPU Plugin - allows to perform deep neural networks inference on NVIDIA GPUs using CUDA, using OpenVINO API.
• Token Merging for Stable Diffusion running with OpenVINO - An OpenVINO adopted version of Token Merging method.
• Drug Discovery “Lipophilicity” using OpenVINO toolkit- Finding Lipophilicity of peptides, proteins and molecules.
• OpenVINO Quantization- Image Quantization Classification using STL 10 Dataset.
• who_what_benchmark - Simple and quick accuracy test for compressed, quantized, pruned, distilled LLMs from NNCF, Bitsandbytes, GPTQ, and BigDL-LLM.
• OpenVINO with Docker - Dockerizing OpenVINO applications.
• OpenVINO AICG Samples - A collection of samples for NLP and Image Generation.
• OpenVINO Model Server k8s Terraform - Deploying Kubernetes cluster via Terraform as well as deploying and hosting a OpenVINO Model Server on it.

Related Communities

See Awesome oneAPI for leading oneAPI and SYCL projects across diverse industries.