An open source inference server to serve your machine learning models.
⚠️ This is a Work in Progress.
MLServer aims to provide an easy way to start serving your machine learning models through a REST and gRPC interface, fully compliant with KFServing's V2 Dataplane spec.