torchserve

There are 1 repository under torchserve topic.

cceyda / torchserve-dashboard
Management Dashboard for Torchserve
torchserve streamlit ml-deployment pytorch
Language:Python 125
serving-pytorch-models
alvarobartt / serving-pytorch-models
Serving PyTorch models with TorchServe :fire:
torchserve pytorch model-serving pytorch-cnn model-deployment machine-learning mlops image-classification serve-pytorch
Language:Jupyter Notebook 102
louisoutin / yolov5_torchserve
Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.
pytorch docker object-detection service batch-inference torchserve deep-learning
Language:Python 100
notAI-tech / fastDeploy
Deploy DL/ ML inference pipelines with minimal extra code.
deep-learning tensorflow-serving tf-serving pytorch serving falcon gevent docker model-deployment model-serving http-server gunicorn torchserve triton-inference-server python triton triton-server inference-server streaming-audio websocket
Language:Python 100
amazon-sagemaker-endpoint-deployment-of-fastai-model-with-torchserve
aws-samples / amazon-sagemaker-endpoint-deployment-of-fastai-model-with-torchserve
Deploy FastAI Trained PyTorch Model in TorchServe and Host in Amazon SageMaker Inference Endpoint
fastai torchserve sagemaker-deployment deep-learning self-driving-car artificial-intelligence pytorch
Language:Jupyter Notebook 73
scaleoutsystems / stackn
A minimalistic and pluggable machine learning platform for Kubernetes.
machine-learning kubernetes model-serving dash jupyter-notebook mlflow tf-serving minio torchserve fastapi rshi mlops rstudio rshiny django
Language:Python 36
cceyda / lit-NER
TorchServe+Streamlit for easily serving your HuggingFace NER models
streamlit huggingface torchserve
Language:Python 33
kamalkraj / Swin-Transformer-Serve
Deploy Swin Transformer using TorchServe
torch pytorch deploy torchserve swin-transformer microsoft eager-load torchscript docker cuda python3
Language:Python 27
manhph2211 / ML-Deployment
Pushing Deep Learning models into production using torchserve, kubernetes and react web app :smile:
text-to-speech kubernetes react tts-api voice-synthesis tts-demo torchserve tts-service mlops mlopsvn mern-project mern-stack-app expressjs mongodb text-to-speech-app text-to-speech-service vietnamese-text-to-speech ml-deployment
Language:Python 27
npatta01 / pytorch-serving-workshop
Slides and notebook for the workshop on serving bert models in production
pytorch deep-learning torchserve mlops
Language:Jupyter Notebook 25
Biano-AI / serving-compare-middleware
FastAPI middleware for comparing different ML model serving approaches
tensorflow torchserve fastapi python triton-inference-server tensorflow-serving pytorch
Language:Python 15
aws-samples / torchserve-eks
How to deploy TorchServe on an Amazon EKS cluster for inference.
eks pytorch torchserve
Language:Shell 13
amazon-sagemaker-endpoint-deployment-of-siamese-network-with-torchserve
aws-samples / amazon-sagemaker-endpoint-deployment-of-siamese-network-with-torchserve
Twin Neural Network Training with PyTorch and fast.ai and its Deployment with TorchServe on Amazon SageMaker
fastai pytorch sagemaker-deployment siamese-neural-network torchserve
Language:Jupyter Notebook 11
Faruman / AnalysisOfMlModelDeploymentOptions
This paper compares Flask, FastAPI, and TorchServe for deploying PyTorch models. Flask is simple, FastAPI adds performance, and TorchServe is best for large-scale production. FastAPI is ideal for small deployments, while TorchServe suits complex environments. AWS Lambda is suggested for advanced use cases.
flask fastapi torchserve
Language:Python 9
artefactory / deploy-fastai-torchserve-aiplatform
Deploy FastAI Trained PyTorch Model in TorchServe and Host in GCP's AI-Platform Prediciton.
ulmfit gcp ai-platform pytorch torchserve
Language:Python 8
AshutoshDongare / HuggingFace-Model-Serving
Quick and easy tutorial to serve HuggingFace sentiment analysis model using torchserve
huggingface model rest-api sentiment-analysis torchserve tutorial devops inference bert-models deployment
Language:Python 8
fabridamicelli / torchserve-docker
TorchServe images with specific Python version working out-of-the-box.
docker neural-networks torchserve container container-image pytorch pytorch-containers torch serving-pytorch-models
Language:Python 8
RamanHacks / pytorch-hackathon
DET is an end-to-end tool for extracting Key-Value pairs from a variety of documents, built entirely on PyTorch and served using TorchServe.
pytorch ner bert torchserve ocr deep-learning
Language:Jupyter Notebook 6
GlenCrawford / musical_valence_predictor
Predicting musical valence of Spotify songs using PyTorch.
machine-learning python pytorch music flask regression classification valence torchserve
Language:Python 5
i008 / pl-lightning-torchserve-neptune-template
This repo implements a minimalistic pytorch_lightning + neptune + torchserve flow for (computer vision) model training and deployment
pytorch torchserve pytorch-lightning
Language:Python 5
bioinf-mcb / BERT-torchserve-quickstart
Serving BERT embeddings via Torchserve
bert nlp torchserve pytorch representation-learning production-service
Language:Python 4
ajithvcoder / Multivideo_Objectdetection_MLOPS_Project
Multi video offline streaming and Yolov8 object detection with Kafka, torch serve, AWS EC2
aws-ec2 confluent-kafka mongodb onnx streaming torchserve flask flask-socketio yolov8
Language:Jupyter Notebook 3
dimitreOliveira / torchserve_od_example
Simple example of using TorchServe to serve a PyTorch Object Detection model
pytorch torchvision torchserve object-detection docker docker-compose faster-rcnn fasterrcnn fastrcnn
Language:Jupyter Notebook 3
froukje / mnist-deployment
Deploy App for MNIST Classification using TorchServe and Flask
deep-learning docker docker-compose flask pytorch torchserve
Language:Python 3
oke-aditya / torch_serve_mnist
Tutorial on how to run MNIST using Torch-Serve
pytorch torchserve mnist deeplearning
Language:Python 3
philippmoehl / ml-lifecycle
ML Lifecycle project
computer-vision streamlit chatgpt openai-api hydra wandb supabase torchserve mlops
Language:Jupyter Notebook 3
williamcorsel / TorchMenu
GUI for managing your TorchServe server
deployment gui mlops pytorch torchserve
Language:Python 3
bc-li / MSRA-USTC-AISystemProject-2021
🥏 My source code for MSRA-USTC Joint Innovation Project 2021 Track AI System: Deploying deep learning model on Docker to prepare for large-scale inference.
dockerfile torchserve inference
Language:Python 2
jatin837 / tomato_health_check_with_computer_vision
Blight detection in tomato 🍅 using convolutional neural networks
convolutional-neural-networks fastapi pytorch torchserve
Language:Python 2
naram92 / DeepFakeDetection-torchserve-deployment
How to deploy the deefake detection model using torchserve
deepfake-detection docker torchserve pytorch
Language:Python 2
stevinc / MNIST-Inference
MNIST inference using torchserve, flask and docker
torchserve mnist-classification pytorch docker flask mlops
Language:Python 2
tadayosi / torchserve-client-java
A Java client library for PyTorch TorchServe
ai client java pytorch torchserve
Language:Java 2
texano00 / TorchServe-Lab
🚀 TorchServe playground includes step by step Kubernetes installation and inference stress tests using JMeter (most models from HuggingFace)
ai mlops pytorch torchserve
Language:Python 2
tripathiarpan20 / HF-torchserve-pipeline
Template to serve, optimize and scale 🤗 pipeline in production with Torchserve & Docker
aws-ec2 deployment docker aws pytorch huggingface-pipeline onnxruntime quantization tensorflow torchserve huggingface-optimum
Language:Python 2
tryumanshow / NER-Pipeline
Simple NER Pipeline Using KoCharELECTRA
docker docker-compose fastapi ner nlp streamlit electra torchserve aws deployment finetuning named-entity-recognition
Language:Python 2
ajithvcoder / emlo4-session-12-ajithvcoder
Use torchserve, fastapi and nextjs to deploy a stable diffusion vision model with docker compose - The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs
aws-s3 docker-compose fastapi gpu nextjs stable-diffusion stable-diffusion-webui torchserve docker-compose-gpu aws-ec2
Language:Python 1

torchserve

cceyda / torchserve-dashboard

alvarobartt / serving-pytorch-models

louisoutin / yolov5_torchserve

notAI-tech / fastDeploy

aws-samples / amazon-sagemaker-endpoint-deployment-of-fastai-model-with-torchserve

scaleoutsystems / stackn

cceyda / lit-NER

kamalkraj / Swin-Transformer-Serve

manhph2211 / ML-Deployment

npatta01 / pytorch-serving-workshop

Biano-AI / serving-compare-middleware

aws-samples / torchserve-eks

aws-samples / amazon-sagemaker-endpoint-deployment-of-siamese-network-with-torchserve

Faruman / AnalysisOfMlModelDeploymentOptions

artefactory / deploy-fastai-torchserve-aiplatform

AshutoshDongare / HuggingFace-Model-Serving

fabridamicelli / torchserve-docker

RamanHacks / pytorch-hackathon

GlenCrawford / musical_valence_predictor

i008 / pl-lightning-torchserve-neptune-template

bioinf-mcb / BERT-torchserve-quickstart

ajithvcoder / Multivideo_Objectdetection_MLOPS_Project

dimitreOliveira / torchserve_od_example

froukje / mnist-deployment

oke-aditya / torch_serve_mnist

philippmoehl / ml-lifecycle

williamcorsel / TorchMenu

bc-li / MSRA-USTC-AISystemProject-2021

jatin837 / tomato_health_check_with_computer_vision

naram92 / DeepFakeDetection-torchserve-deployment

stevinc / MNIST-Inference

tadayosi / torchserve-client-java

texano00 / TorchServe-Lab

tripathiarpan20 / HF-torchserve-pipeline

tryumanshow / NER-Pipeline

ajithvcoder / emlo4-session-12-ajithvcoder