inference-api
There are 3 repositories under inference-api topic.
- inference
roboflow / inference
A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
Language:Python 1154 BMW-InnovationLab / BMW-TensorFlow-Training-GUI
This repository allows you to get started with a gui based training a State-of-the-art Deep Learning model with little to no configuration needed! NoCode training with TensorFlow has never been so easy.
Language:Python 966- truss
basetenlabs / truss
The simplest way to serve AI/ML models in production
Language:Python 858 quic / ai-hub-models
The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
Language:Python 351Michael-OvO / Yolov7-Flask
A Beautiful Flask Web API for Yolov7 (and custom) models
Language:Python 207- deep-learning-training-gui
mustafamerttunali / deep-learning-training-gui
Train and predict your model on pre-trained deep learning models through the GUI (web app). No more many parameters, no more data preprocessing.
Language:Python 130 - Language:Python 120
This repository allows you to get started with training a State-of-the-art Deep Learning model with little to no configuration needed! You provide your labeled dataset and you can start the training right away. You can even test your model with our built-in Inference REST API. Training classification models with GluonCV has never been so easy.
Language:Python 73- hfapigoLanguage:Go 54
This is a repository for an image classification inference API using the Gluoncv framework. The inference REST API works on CPU/GPU. It's supported on Windows and Linux Operating systems. Models trained using our Gluoncv Classification training repository can be deployed in this API. Several models can be loaded and used at the same time.
Language:Python 50intelligencedev / eternal
Eternal is an experimental platform for machine learning models and workflows.
Language:Go 30hupe1980 / go-huggingface
🤗 Hugging Face Inference Client written in Go
Language:Go 27TimMikeladze / huggingface
Typescript wrapper for the Hugging Face Inference API.
Language:TypeScript 27Prismadic / magnet
the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
Language:Python 21yas-sim / openvino-ep-enabled-onnxruntime
Describing How to Enable OpenVINO Execution Provider for ONNX Runtime
Language:C++ 18decisionfacts / semantic-ai
An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).
Language:Python 17BorjaOteroFerreira / IALab-Suite
Tool for test diferents large language models without code.
Language:Python 16- com.rest.huggingface
RageAgainstThePixel / com.rest.huggingface
A Non-Official HuggingFace Rest Client for Unity (UPM)
Language:C# 15 shivamMg / stable-diffusion-on-azureml
REST APIs for StableDiffusion. Inferencing support on AzureML
Language:Jupyter Notebook 11- Language:Python 8
gmkung / Cheemera
A Node.js backend that exposes a Typescript implementation of the deCheem inference engine.
Language:Python 8pandruszkow / whisper-inference-server
A networked inference server for Whisper so you don't have to keep waiting for the audio model to reload for the x-hunderdth time.
Language:Python 8- Language:Python 7
ingyuseong / rabbitmq-inference
A message queue based server architecture to asynchronously handle resource-intensive tasks (e.g., ML inference)
Language:Python 6geniusrise / text
Text components powering LLMs & SLMs for geniusrise framework
Language:Python 5- ml-in-production-practice
kyryl-opens-ml / ml-in-production-practice
Practice for Machine Learning in Production course
Language:Python 5 pchandrasekaran1595 / Computer-Vision-API
Computer VIsion API built using FastAPI and pretrained models converted to ONNX format
Language:Python 5YAV-AI / NodeJS-Stable-Diffusion-XL-Base-1.0-Hugging-Face-Inference-API
A simple node.js example that generates an image using StableDiffusion via Hugging Face Inference API.
Language:JavaScript 5- Computer-Vision-API-V2
Computer Vision API V2 - FastAPI & ONNX Models
Language:Python 4 ChildishGirl / monitoring-lambda-ml-inference
Monitor Lambda ML inference with CloudWatch Dashboard using AWS CDK (Python)
Language:Python 3ededddy / groq-api-rs
A Rust Client For groq Inference API
Language:Rust 3- Language:HTML 3
scattering-ai / MLDrop
MLDrop model serving for Pytorch
The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
Language:Java 1Santhoshmani1 / Inferhub
Text to image generation with stable diffusion xl model powered by hugging face inference api
Language:JavaScript 1
