[Doc][model] How to start in cluster mode?
adogwangwang opened this issue · comments
Search before asking
- I had searched in the issues and found no similar feature requirement.
Description
各位大佬好，我需要用远程的自己部署的模型，需要通过部署成worker的形式注册到controller当中，那么注册后，是否每个界面的模型下拉菜单中就出现这个模型选项了？api-server 和 controller是否需要手动启动？如果启动dbgpt-server.py时 ，不想指定从本地load进入模型，希望检测集群内部署的 worker llm 注册进下拉框，是否可以？应该怎么做？
Documentation Links
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
默认启动模式是单机启动模式，集群启动参考文档
默认启动模式是单机启动模式，集群启动参考文档
感谢您的回复，那么我在镜像的启动命令就不是python dbgpt_server.py 了吗？
集群模式 + docker 推荐看看 docker/compose_examples/cluster-docker-compose.yml
This issue has been marked as stale, because it has been over 30 days without any activity.
This issue bas been closed, because it has been marked as stale and there has been no activity for over 7 days.