ai-inference

There are 1 repository under ai-inference topic.

BentoML
bentoml / BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
model-serving mlops llmops generative-ai llm-inference model-inference-service inference-platform deep-learning llm-serving machine-learning python multimodal ml-engineering llm ai-inference
Language:Python 8191
uxlfoundation / scikit-learn-intelex
Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
oneapi scikit-learn machine-learning-algorithms data-analysis machine-learning python swrepo ai-machine-learning big-data analytics ai-training ai-inference gpu hacktoberfest
Language:Python 1318
oneDAL
uxlfoundation / oneDAL
oneAPI Data Analytics Library (oneDAL)
onedal data-analysis oneapi machine-learning machine-learning-algorithms hacktoberfest swrepo ai-machine-learning big-data analytics ai-training ai-inference cpp data-science
Language:C++ 642
dffml
intel / dffml
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
machine-learning data-flow asyncio event-based flow-based-programming dag hyperautomation dataflows datasets dffml swrepo ai-inference ai-training analytics ai-machine-learning frameworks libraries models pipelines python
Language:Python 254
blace-ai / blace-ai
Cross-platform c++ sdk & model hub for easy ai inference
ai-hub ai-inference ai-sdk cpp libtorch onnxruntime
Language:C++ 63
okba14 / NeuroHTTP
High-Performance AI-Native Web Server — built in C & Assembly for ultra-fast AI inference and streaming.
ai-inference ai-inference-server ai-native assembly c-language grpc grpc-server high-performance http3 low-latency neural open-source web-server
Language:C 47
philips-software / go-hsdp-api
Client library to interact with various APIs used within Philips in a simple and uniform way
ai-inference ai-training ai-workspace auditing cartel cdl cdr fhir fhir-client hsdp hsdp-api iam iot ironio logging pki tdr
Language:Go 32
redbco / infermesh
GPU-aware inference mesh for large-scale AI serving
ai-inference ai-infrastructure distributed-systems fault-tolerance gpu-inference high-availability inference-engine ml-infrastructure model-serving observability rust service-mesh gpu-mesh
Language:Rust 25
ayutaz / uPiper
Unity TTS plugin: Piper neural synthesis + OpenJTalk Japanese + Unity AI Inference Engine. Windows/Mac/Linux/Android/iOS ready. High-quality voices for games & apps.
ai-inference text-to-speech tts unity unity-plugin
Language:C# 15
JetInfero
tinyBigGAMES / JetInfero
Local LLM Inference Library
llama-cpp win64 c-cpp pascal local-inference ai-inference library procedural-api
Language:Pascal 12
open-vela / apps_mlearning_tflite-micro
Customed version of Google's tflite-micro
ai-inference inference-embedded-engine tflite-micro
Language:C++ 8
dhanushk-offl / ai-inference-backend-boilerplate
A powerful, faster, scalable full-stack boilerplace for AI inference using Node.js, Python, Redis, and Docker
ai ai-backend ai-backend-server ai-inference backend-api boilerplate-template nodejs redis transformer
Language:JavaScript 3
valvebara / valvebara
No more Hugging Face cost leaks.
ai-inference billing huggingface nextjs save-money vercel
Language:TypeScript 3
arbitrary-number / arbitrary-number
Arbitrary Numbers
ai-inference ai-performance consumer-gpu cuda deep-learning edge-inference gpu machine-learning model-optimization model-serving numerical-computing nvidia python pytorch tensorflow
Language:Python 2
KDsudheera / greenhouse-ai-fancontroller
🌱 Intelligent IoT greenhouse fan controller using AI/ML for automated climate control. Features ESP32 + DHT22 sensors, real-time Firebase integration, Flutter mobile app with TensorFlow Lite on-device inference, and Wokwi simulation. Complete full-stack solution demonstrating IoT + AI integration.
ai-inference dht22sensor edge-ai embedded-systems esp32 firebase flutter greenhouse-automation iot machine-learning mobile-app platformio real-time-database relay smart-farming tensorflow-lite wokwi
Language:Dart 1
robert008 / flutter_face_kit
A personal demo project for Flutter + ONNX Runtime integration. Not related to any company work.A comprehensive on-device face recognition SDK for Flutter
ai-inference face-recognition ffi flutter-demo flutter-plugin insightface ondevice-ai onnxruntime open-source opencv
Language:C++ 1
UniUi
calinux-py / UniUi
UniUi uses AI to allow you to talk directly to your system.
ai ai-inference ai-integration ai-ui interface openai openai-api python-ai-agent text-to-command uniui
Language:JavaScript 0
ai-action / ai-inference-demo
AI Inference in GitHub Actions demo
ai ai-inference ci github-action github-actions large-language-model large-language-models llm model
Atriva-AI-Community / community
Community governance, contribution rules, and roadmap for the Edge AI open platform.
ai-inference camera-vision community edge-ai open-source video-acceleration
europanite / client_side_ai_training
Image AI Training And Inference For Every One, For Free
ai browser client-side education frontend image image-classification react typescript docker docker-compose expo react-native image-recognition ai-inference ai-training free jest
Language:TypeScript
frankbesch / nimble-oke
Nimble OKE — deploy NIM on Oracle OKE in minutes for under $50. From zero → smoke test → cleanup, Nimble OKE makes production-ready AI inference fast, affordable, and repeatable.
ai-inference cost-optimization devops gitops gpu helm kubernetes llm llm-inference nvidia-nim oke oracle-cloud platform-engineering smoke-testing
Language:Shell
hanax-ai / Citadel-Beta
Citadel AI OS – Enterprise AI Runtime Environment for Inference, Agents, and Business Operations
ai-inference enterprise-ai fastapi governance multi-agent python rag ai-operating-system clerk-identity proactor-agent
Language:JavaScript