shunk031 / libtorch-gin-api-server

High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)

High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)

Convert your model to torch script

$ python convert_to_torch_script_via_tracing.py
# converted model is saved to assets/model.pt

How to Run

$ docker-compose up api

Credits

Parts of the implementation is borrowed from rai-project/go-pytorch.