model-inference

There are 1 repository under model-inference topic.

bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna
Language:Python 11928
wangxb96 / Awesome-EdgeAI
Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"
data-preprocessing edge-ai edge-computing efficient-algorithm machine-learning model-acceleration model-compression model-inference tiny-ml awesome-list deep-learning model-deployment model-design
98
bentoml / CLIP-API-service
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
ai-applications clip cloud-native mlops model-inference model-inference-service model-serving openai-clip
Language:Jupyter Notebook 65
hegongshan / Storage-for-AI-Paper
Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)
data-storage deep-learning mlsys storage-system storage-for-ai pytorch tensorflow checkpoint data-preprocessing data-loading data-preparation dataloader model-inference model-storage model-training
50
EmbeddedLLM / embeddedllm
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
llm llm-inference directml directx-12 gemma llama mistral phi-3 llm-serving model-inference open-source-llm aipc npu windows ipexllm cpu openvino openvino-inference-engine
Language:Python 44
DAVIDNYARKO123 / edge-tpu-silva
Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on an Edge TPU USB.
coral-tpu edge-computing fps machine-learning model-inference object-detection pycoral raspberry-pi raspberry-pi-4
Language:Python 30
Koldim2001 / Image_captioning
Генерация описаний к изображениям с помощью различных архитектур нейронных сетей
attention-mechanism captioning-images computer-vision image-captioning lstm model-deployment model-inference nlp soft-attention streamlit website word-embeddings
Language:Jupyter Notebook 18
debajitadhikary / EmoVision
😊📸 Real-Time Facial Emotion Recognition using Deep Learning 🤖🧠
ai cnn computer-vision cudnn deep-learning emotion-detection emotion-recognition facial-expression-recognition git gpu-computing haarcascade machine-learning model-inference nvidia opencv real-time tensorflow neural-networks
Language:Python 5
brian-kipkoech-tanui / sagemaker-ML-workflow
Image Classifiers are used in the field of computer vision to identify the content of an image and it is used across a broad variety of industries, from advanced technologies like autonomous vehicles and augmented reality, to eCommerce platforms, and even in diagnostic medicine.
aws aws-ec2 aws-lambda aws-s3 aws-statemachine aws-step-functions endpoint image-classification json model-evaluation model-inference model-testing python sagemaker sagemaker-deployment sagemaker-studio
Language:HTML 4
ChaitanyaC22 / Udacity-AWS-MLE-ND-Project2-Build-a-ML-Workflow-For-Scones-Unlimited-On-Amazon-SageMaker
The primary objective of this project was to build and deploy an image classification model for Scones Unlimited, a scone-delivery-focused logistic company, using AWS SageMaker.
aws aws-ec2 aws-iam aws-lambda aws-s3 aws-sagemaker aws-statemachine aws-step-functions deployment endpoint image-classification lambda-functions model-inference model-testing python python3 sagemaker-deployment sagemaker-studio model-evaluation json
Language:HTML 4
akrisanov / inference-engineering-journey
A personal journey into model inference engineering — learning, building, and sharing along the way.
jupyter-notebook learning-in-public machine-learning-journey model-inference personal-notes python inference-engineering
Language:Jupyter Notebook 2
SayamAlt / Financial-News-Sentiment-Analysis
Successfully developed a fine-tuned DistilBERT transformer model which can accurately predict the overall sentiment of a piece of financial news up to an accuracy of nearly 81.5%.
data-exploration-and-preprocessing distilbert-model fine-tune-bert-tensorflow hugging-face-transformers model-architecture-and-implementation model-inference model-training-and-evaluation multiclass-classification natural-language-processing sentiment-analysis text-preprocessing text-tokenization
Language:Jupyter Notebook 2
SayamAlt / Symptoms-Disease-Text-Classification
Successfully developed a fine-tuned BERT transformer model which can accurately classify symptoms to their corresponding diseases upto an accuracy of 89%.
bert-fine-tuning data-exploration-and-preprocessing exploratory-data-analysis fine-tune-bert-tensorflow hugging-face-transformers model-architecture-and-implementation model-inference model-training-and-evaluation multiclass-classification natural-language-processing text-classification text-preprocessing text-tokenization
Language:Jupyter Notebook 2
AlvinHon / distributed-model-inference
Example distributed system for ML model inference by using Kafka, including spring boot REST+JPA server with Java consumer program
jpa kafka model-inference spring-boot
Language:Java 1
itancio / churn
machine-learning model-inference python3 streamlit
Language:Python 1
kwame-mintah / gcp-cloud-run-function-model-inference
A cloud run function to invoke a prediction against a machine learning model that has been trained outside of a cloud provider.
cloud-functions gcp google-cloud-platform model-inference fastapi
Language:Python 1
SayamAlt / Cyberbullying-Classification-using-fine-tuned-DistilBERT
Successfully fine-tuned a pretrained DistilBERT transformer model that can classify social media text data into one of 4 cyberbullying labels i.e. ethnicity/race, gender/sexual, religion and not cyberbullying with a remarkable accuracy of 99%.
cyberbullying-detection data-exploration distilbert-model exploratory-data-analysis fine-tune-bert-tensorflow llm model-inference model-training-and-evaluation multiclass-classification natural-language-processing text-classification text-preprocessing text-tokenization
Language:Jupyter Notebook 1
thehrsr / CAR-DAMAGE-DETECTION
This project is a web-based application that uses a pre-trained Mask R-CNN model to detect and classify car damage types (scratch, dent, shatter, dislocation) from images. Users can upload an image of a car, and the application will highlight damaged areas with bounding boxes and masks, providing a clear visual representation of the detected damage
ai computer-vision custom-dataset deep-learning flask image-processing image-segmentation machine-learning mask-rcnn model-inference mrcnn object-detection python tensorflow web-application
Language:Jupyter Notebook 1
C-bianc / NER-task
Token classification for named entities
lstm model-inference ner ray-tune token-classification
Language:Jupyter Notebook 0
Keval10github / Vehicle-Detection
This vehicle identification project utilizes the YOLOv5 deep learning model for detecting and classifying vehicles from images, videos, and live streams. It supports real-time inference, saving outputs with bounding boxes, confidence scores, and class labels, making it ideal for traffic monitoring and smart surveillance systems.
automated-labelling computer-vision data-augmentation deep-learning image-processing model-inference non-maximum-suppression object-detection pytorch real-time-detection smart-surveillance tensorflow-lite traffic-monitoring vehicle-detection video-processing yolov3 yolov5
Language:Python 0
Anip95 / satellite-vehicle-detection-classification
bounding-boxes clahe class-imbalance computer-vision data-augmentation dataset-splitting deep-learning gamma-correction image-classification image-processing jupyter-notebook model-inference multiclass-classification object-detection python satellite-imagery yolov11 xview-dataset
Language:Jupyter Notebook
csysp / rocktop
rocktop is a singing voice model training/inference system with a full test env and MCP server for devs
hydra kubernetes machine-learning mcp-server model-inference model-training music open-source python3 singing-voice-conversion sox vocal vocal-conversion
Language:Python
hnthap / cat-or-dog
An End-to-end AI Application classifying images as either a cat or a dog. The project leverages OpenVINO Model Server, a Node.js backend, and a React-based frontend.
axios docker docker-compose express full-stack image-classification image-preprocessing machine-learning model-deployment model-inference nodejs react rest-api sharp vite website javascript typescript self-host
Language:TypeScript
nabeelshan78 / yolo-object-detection-pipeline
An end‑to‑end TensorFlow/Keras implementation of the YOLO object detection pipeline. Load images, run fast and accurate bounding‑box inference, filter and refine predictions and visualize results side‑by‑side - all organized into a clean, modular workflow.
autonomous-driving bounding-boxes classification convolutional-neural-networks cvpr deep-learning keras model-inference neural-network non-maximum-suppression object-detection object-localization real-time-detection tensorflow vision-ai yolo yolov2
Language:Jupyter Notebook
Nardo45 / RapidVision
RapidVision is a real-time object detection tool powered by the PP-YOLOE deep learning model and the COCO object class dataset. It supports switching between multiple video sources and is built for responsive, flexible object recognition.
computer-vision deep-learning model-inference neural-networks object-detection opencv pp-yoloe ppyoloe pyqt python3 pytorch real-time video-processing
Language:Python
santosh / image-classifier
POC of image classification using scikit-learn.
computer-vision machine-learning model-inference model-training parking-lot scikit-learn
Language:Python
SayamAlt / English-to-Spanish-Language-Translation-using-Seq2Seq-and-Attention
Successfully established a Seq2Seq with attention model which can perform English to Spanish language translation up to an accuracy of almost 97%.
attention-is-all-you-need attention-model bert-transformer exploratory-data-analysis fine-tuning-bert hugging-face-transformers language-translation luong-attention model-architecture-and-implementation model-inference model-training-and-evaluation natural-language-processing neural-machine-translation seq2seq-modeling text-generation text-preprocessing text-tokenization
Language:Jupyter Notebook
SayamAlt / Global-Equity-Forecasting-using-LSTM
Successfully established an LSTM model to effectively forecast global equity based on over 20+ years of historical data of global equity.
data-loaders deep-learning feature-scaling forecast-evaluation gradient-clipping lstm-neural-networks model-inference model-training-and-evaluation pytorch recurrent-neural-networks time-series-datasets time-series-forecasting xavier-initialization
Language:Jupyter Notebook
SayamAlt / Global-News-Headlines-Text-Summarization
Successfully established a text summarization model using Seq2Seq modeling with Luong Attention, which can give a short and concise summary of the global news headlines.
attention-mechanism data-exploration-and-preprocessing luong-attention model-architecture-and-implementation model-inference natural-language-processing seq2seq-model text-generation text-summarization text-tokenization
Language:Jupyter Notebook
SayamAlt / Grapevine-Leaves-Image-Classification-Using-CNNs
Successfully developed an image classification model using PyTorch to classify the species of grapevine leaves based on their corresponding images.
alexnet-pytorch convolutional-neural-networks data-loader deep-learning densenet169 fine-tuning-cnns image-classification mobilenetv3-large model-inference model-training-and-evaluation multiclass-classification resnet50 vgg19
Language:Jupyter Notebook
SayamAlt / Luxury-Apparel-Product-Category-Classification-using-fine-tuned-DistilBERT
Successfully developed a multiclass text classification model by fine-tuning pretrained DistilBERT transformer model to classify various distinct types of luxury apparels into their respective categories i.e. pants, accessories, underwear, shoes, etc.
deep-learning distilbert-fine-tuning distilbert-model exploratory-data-analysis fine-tuning-bert model-inference model-training-and-evaluation multiclass-classification natural-language-processing text-classification text-preprocessing text-tokenization
Language:Jupyter Notebook
SayamAlt / Mental-Health-Classification-using-fine-tuned-DistilBERT
Successfully established a multiclass text classification model by fine-tuning pretrained DistilBERT transformer model to classify several distinct types of mental health statuses such as anxiety, stress, personality disorder, etc. with an accuracy of 77%.
data-visualization deep-learning distilbert-fine-tuning distilbert-model model-evaluation model-inference model-training-and-evaluation multiclass-text-classification natural-language-processing text-classification text-preprocessing text-tokenization
Language:Jupyter Notebook
SayamAlt / Natural-Scenes-Image-Classification-using-CNNs
Successfully established an image classification model using PyTorch to classify the images of several distinct natural sceneries such as mountains, glaciers, forests, seas, streets and buildings with an accuracy of 86%.
convolutional-neural-networks deep-learning fine-tuning-cnns flask-deployment image-classification image-transformations model-inference model-training-and-evaluation multiclass-classification pytorch resnet50-model torch-dataloader
Language:Jupyter Notebook
SayamAlt / Oral-Disease-Classification-using-CNN
Successfully developed an image classification model using PyTorch to classify two types of oral diseases, namely caries and gingivitis.
binary-classification convolutional-neural-networks data-loader deep-learning image-classification image-transformations model-inference model-training-and-evaluation pytorch
Language:Jupyter Notebook
SayamAlt / Wildlife-Detection-using-Faster-R-CNN
Successfully developed a wildlife detection model using Faster R-CNN to identify and localize animals in natural habitats, supporting conservation efforts and ecological research.
computer-vision deep-learning faster-rcnn faster-rcnn-pytorch faster-rcnn-resnet image-processing model-inference object-detection pytorch torch torchvision torchvision-datasets torchvision-model torchvision-transforms wildlife-detection convolutional-neural-networks resnet50-fasterrcnn pretrained-models
Language:Jupyter Notebook
SayamAlt / Wine-Cultivator-Classification-using-ANN
Successfully established an ANN model which can classify wine cultivators based on several characteristics of distinct wines.
artificial-neural-networks classification deep-learning model-inference model-training-and-evaluation multiclass-classification pytorch
Language:Jupyter Notebook

model-inference

bentoml / OpenLLM

wangxb96 / Awesome-EdgeAI

bentoml / CLIP-API-service

hegongshan / Storage-for-AI-Paper

EmbeddedLLM / embeddedllm

DAVIDNYARKO123 / edge-tpu-silva

Koldim2001 / Image_captioning

debajitadhikary / EmoVision

brian-kipkoech-tanui / sagemaker-ML-workflow

ChaitanyaC22 / Udacity-AWS-MLE-ND-Project2-Build-a-ML-Workflow-For-Scones-Unlimited-On-Amazon-SageMaker

akrisanov / inference-engineering-journey

SayamAlt / Financial-News-Sentiment-Analysis

SayamAlt / Symptoms-Disease-Text-Classification

AlvinHon / distributed-model-inference

itancio / churn

kwame-mintah / gcp-cloud-run-function-model-inference

SayamAlt / Cyberbullying-Classification-using-fine-tuned-DistilBERT

thehrsr / CAR-DAMAGE-DETECTION

C-bianc / NER-task

Keval10github / Vehicle-Detection

Anip95 / satellite-vehicle-detection-classification

csysp / rocktop

hnthap / cat-or-dog

nabeelshan78 / yolo-object-detection-pipeline

Nardo45 / RapidVision

santosh / image-classifier

SayamAlt / English-to-Spanish-Language-Translation-using-Seq2Seq-and-Attention

SayamAlt / Global-Equity-Forecasting-using-LSTM

SayamAlt / Global-News-Headlines-Text-Summarization

SayamAlt / Grapevine-Leaves-Image-Classification-Using-CNNs

SayamAlt / Luxury-Apparel-Product-Category-Classification-using-fine-tuned-DistilBERT

SayamAlt / Mental-Health-Classification-using-fine-tuned-DistilBERT

SayamAlt / Natural-Scenes-Image-Classification-using-CNNs

SayamAlt / Oral-Disease-Classification-using-CNN

SayamAlt / Wildlife-Detection-using-Faster-R-CNN

SayamAlt / Wine-Cultivator-Classification-using-ANN