mosaicml / llm-foundry

LLM training code for Databricks foundation models

Home Page:https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Possibility of training with hostname instead IP

germanjke opened this issue · comments

Hi!

Is it possible to start multi-node training with hostname, but not ip master address of master node?

Depends exactly what you mean. A hostname is generally resolved to an IP, and that must be the case here. Otherwise the nodes don't know how to communicate.