awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

SAGEMAKER_MULTI_MODE in Ping should be SAGEMAKER_MULTI_MODEL

fm1ch4 opened this issue · comments

Per AWS documentation[1], the environment variable to decide if the container is running in Multi Model mode is SAGEMAKER_MULTI_MODEL, while in Ping.java the environment variable read is SAGEMAKER_MULTI_MODE[2]

[1] - https://docs.aws.amazon.com/sagemaker/latest/dg/build-multi-model-build-container.html

[2] -

String isMultiModelMode = System.getenv("SAGEMAKER_MULTI_MODE");