awesome-openvino
github.com/openvinotoolkit/awesome-openvino ↗A curated list of OpenVINO based AI projects
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me generative ai resources from awesome-openvino"
Installation instructions →What's inside
Generative AI
- AI structured data Extraction
A streamlit interface with NuExtract-1.5-tiny and openvino-genai to extract data from plain text into structured custom json formats. The Repo also gives a small tutorial on how to convert NuExtract-1.5-tiny into OpenVINO IR format.
- AI Video Builder
Make videos with AI images from YouTube videos.
- BlurAnything
An adaptation of the excellent Track Anything project which is in turn based on Meta's Segment Anything and XMem.
- Enhancing Customer Service with Real-Time Sentiment Analysis: Leveraging LLMs and OpenVINO for Instant Emotional Insights
The integration of LLMs with sentiment analysis models, further optimised by OpenVINO.
- Fast SD
FastSD CPU is a faster version of Stable Diffusion on CPU. Based on Latent Consistency Models and Adversarial Diffusion Distillation.
- Gemma2-2b AI Chat App
A beautiful Chat Interface, with interactive tuning parameters, powered by Optimum-Intel[openvino], Streamlit and the small but powerful Gemma2-2b-instruct model by Google. The model is an int4 quantized version, hosted on Hugging Face Hub.
Miscellaneous
- Application of Vision Language Models with ROS 2
Dives into vision-language models for Robotics applications using ROS 2 and Intel OpenVINO toolkit.
- Drug Discovery “Lipophilicity” using OpenVINO toolkit
- From CPU to NPU: The Secret to ~15x Faster AI on Intel’s Latest Chips
This post discusses Intel's new Neural Processing Unit (NPU) chips, which provide a significant performance boost for AI and machine learning tasks compared to regular CPUs, and provides steps for testing its capabilities using OpenVINO.
- https://github.com/AbhiLegend/DrugDisOpenVINO
- JAX: Artificial Intelligence for everyone.
JAX (Just an Artificial Intelligence Extended) is an optimized version of the openSUSE Linux image to work with openVINO. This platform was designed to facilitate the access and development of AI applications.
- NVIDIA GPU Plugin
allows to perform deep neural networks inference on NVIDIA GPUs using CUDA, using OpenVINO API.
AI Computer Vision
- BMW-IntelOpenVINO-Detection-Inference-API
This is a repository for an object detection inference API using OpenVINO, supporting both Windows and Linux operating systems
- Cerberus
Dog Breed Classification and Body Localization.
- CGD OpenVINO Demo
Efficient Inference and Quantization of CGD for Image Retrieval.
- Cigarette Detection
The project begins by YOLOv8-pose detecting human body positions and extracting skeletal information from images. Based on the skeletal poses, it assesses the elbow angles and the distance between hands and mouths for each individual. If successful, the RTDETR model is employed to detect cigarettes at the mouth zone.
- Clip-Chinese
Chinese image-text similarity matching tasks, leverage OpenVINO and the Towhee embedding library.
- Computer Vision Models As Service
implements different Computer Vision Deep Learning Models as a service.
Educational
- Custom OpenVINO server from scratch
- NTUST Edge AI 2023 Artificial Intelligence and Edge Computing Practice
Educational meterials about AI and Edge Computing Practice GNU IMAGE MANIPULATION PROGRAM
- OpenVINO Handbook
A published
Frameworks
- ExecuTorch OpenVINO Backend
OpenVINO backend for ExecuTorch enabling optimized PyTorch edge inference on CPU, GPU, and NPU targets.
- Keras 3
Keras 3 is a multi-backend deep learning framework, with support for JAX, TensorFlow, PyTorch, NumPy and OpenVINO. User can switch on OpenVINO backend for models inference using Keras API.
- langchain-openvino
Community project extending LangChain with OpenVINO support for LLMs, embeddings, Whisper, and Vision-Language Models.
- LangChain OpenVINO integration
Officially supported LangChain backend for running LLMs, embeddings, and rerankers with OpenVINO, suitable for RAG and Agent pipelines on CPU, GPU, and NPU.
- OpenVINO torch.compile backend
Run PyTorch models natively on OpenVINO using
- Optimum Intel
Hugging Face integration layer for OpenVINO supporting Transformers, Diffusers, and SentenceTransformers with INT4/INT8 quantization via NNCF.
Further resources:
Multimodal projects
- Indoor Care Chatbot
An Elderly Indoor Care Chatbot with an object detection algorithm.
- SA2
Vision-Oriented MultiModal AI.
- Scene Explorer for kids
Integration of a chat bot with an object detection algorithm.
Natural Language Processing
- Japanese chatbot Youri
LLM Japanese chatbot demo program using Intel OpenVINO toolkit.
- OpenVINO GPT-Neo
a port of GPT-Neo that uses OpenVINO.
- Resume-Based Interview Preparation Tool
The Resume-Based Interview Preparation Tool is a software application designed to streamline the interview process by helping interviewers generate relevant and meaningful questions based on a candidate's resume or portfolio page.
Showing a sample of 98 resources. View the full list on GitHub →