You can choose to use the one of the following method:
Dockerfile
docker buildx build -t <docker_hub_user_name>/<image_name> --push .
build.envd
envd build -f :serving --output type=image,name=docker.io/<docker_hub_user_name>/<image_name> --push
OpenAI compatible API for open source LLMs (LLaMA, ChatGLM, MOSS and many others)
You can choose to use the one of the following method:
Dockerfile
docker buildx build -t <docker_hub_user_name>/<image_name> --push .
build.envd
envd build -f :serving --output type=image,name=docker.io/<docker_hub_user_name>/<image_name> --push
OpenAI compatible API for open source LLMs (LLaMA, ChatGLM, MOSS and many others)