serving-pytorch-models

There are 2 repositories under serving-pytorch-models topic.

ahkarami / Deep-Learning-in-Production
In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
angularjs c-plus-plus caffe2 convert-pytorch-models deep-learning deep-neural-networks flask keras model-serving mxnet production python pytorch react rest-api serving serving-pytorch-models tensorflow-models tesnorflow tutorial
4380
clearml / clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
machine-learning mlops devops deep-learning kubernetes ai clearml model-serving serving serving-pytorch-models serving-ml tensorflow-serving triton triton-inference-server
Language:Python 157
model_deployment
balavenkatesh3322 / model_deployment
A collection of model deployment library and technique.
model model-deployment model-serving model-server tensorflow keras pytorch aws azure serving serving-pytorch-models serving-recommendation serving-tensors caffe mxnet machine-learning deep-learning neural-network data-science
72
gasparian / PicsArtHack-binary-segmentation
Segmenting people on photos using IOS devices [Pytorch; Unet]
pytorch image-segmentation mobilenetv2 mobilenet resnet deeplearning computer-vision ios-app coreml unet serving-pytorch-models onnx onnx-torch machine-learning
Language:Python 62
SapienzaNLP / usea
Universal Semantic Annotator (LREC 2022)
amr-parsing api lrec lrec2022 natural-language-processing nlp onnx pytorch semantic-parsing semantic-role-labeling serving-pytorch-models word-sense-disambiguation
Language:Shell 17
bcaitech1 / p3-dst-chatting-day
Chatting-Day's Dialogue State Tracking (DST)
dst dialogue-state-tracking wizard-of-seoul serving-pytorch-models
Language:Python 13
lukedeo / torch-serving
Simple HTTP serving for PyTorch 🚀
tensors pytorch python jit-model jit torch serving-pytorch-models machine-learning deep-learning cpp c-plus-plus-11 libtorch torchscript serving-layer
Language:C++ 10
fabridamicelli / torchserve-docker
TorchServe images with specific Python version working out-of-the-box.
docker neural-networks torchserve container container-image pytorch pytorch-containers torch serving-pytorch-models
Language:Python 8
ingyuseong / rabbitmq-inference
A message queue based server architecture to asynchronously handle resource-intensive tasks (e.g., ML inference)
cloudamqp deep-learning gan inference inference-api machine-learning mlops rabbitmq rabbitmq-consumer rabbitmq-producer rabbitmq-server serving-pytorch-models
Language:Python 7
Lake-Wang / MLops_System_NBA_Attendance
End-to-end NBA analytics pipeline for predicting game outcomes and attendance using PyTorch, MLflow, and ONNX. Includes data scraping, model training, quantization, and scalable deployment with FastAPI and Triton Inference Server.
data-pipeline fastapi monitoring onnx-models serving-pytorch-models
Language:Jupyter Notebook 1
nikitajz / pytorch-flask-inference
Serving PyTorch model using flask and docker
pytorch flask deep-learning serving-pytorch-models docker
Language:Python 1
IonBoleac / serve-torch-deployments
A proof-of-concept on how to install and use Torchserve in various mode
docker k8s microk8s minikube python serving-pytorch-models torchserve model-explanation model-management model-predictions pytorch serving
Language:Python 0