Do we have plans for support slurm ?
YixinSong-e opened this issue · comments
I love this project. And I use the project to train my LLM.
But when I want to scale to more nodes in slurm. It doesn't work well.
mosaicml / llm-foundry
LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm