BatchingRPCServer
Building a tool to serve GPU-enabled tools by batching requests and processing them at once.
Depends on MXNet==0.12.0, gRPC>=1.5, protobuf>=3.5, libuuid>=1.5, cmake==3.10.0
Serving stateless GPU applications with batching and gRPC
Building a tool to serve GPU-enabled tools by batching requests and processing them at once.
Depends on MXNet==0.12.0, gRPC>=1.5, protobuf>=3.5, libuuid>=1.5, cmake==3.10.0
Serving stateless GPU applications with batching and gRPC
https://bzcheeseman.github.io/BatchingRPCServer
Apache License 2.0