alibaba / rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Error in DeployDocker.md

vegetable-yx opened this issue · comments

There is an error in

# 如果是cuda11的环境,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda11
# 如果是cuda12的环境,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda12
sh ./create_container.sh <CONTAINER_NAME>
sh  CONTAINER_NAME/sshme.sh

create_container.sh receives 2 parameters. The first is CONTAINER_NAME, the second is IMAGE_NAME. So it might be like this:

# 如果是cuda11的环境,IMAGE_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda11
# 如果是cuda12的环境,IMAGE_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda12
sh ./create_container.sh <CONTAINER_NAME> <IMAGE_NAME>
sh  CONTAINER_NAME/sshme.sh

And CONTAINER_NAME should preferably be without colon because errors may occur in the docker command.

Thanks for issue. Later we'll update doc.