Serving a PyTorch machine learning model within a Docker container using GPU inference
https://www.paepper.com/blog/posts/pytorch-gpu-inference-with-docker/
This project illustrates how to serve a PyTorch model as a REST API using a simple CIFAR model for illustration from the PyTorch CIFAR tutorial.
This is done using Flask, Docker and PyTorch.
For full details about the approach and how to run it yourself, see my blog post covering the details
Serving a PyTorch machine learning model within a Docker container using GPU inference
https://www.paepper.com/blog/posts/pytorch-gpu-inference-with-docker/