Giters

DachengLi1 / LongChat

Official repository for LongChat and LongEval

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Multi-node training?

XueFuzhao opened this issue · comments

commented

Hi,
Thanks for the great work!
Are there any support for multi-node training?

commented

@XueFuzhao Thanks for trying out! Yes, we are compatible with native PyTorch multi-node training. For instance, use --nproc_per_node=8 --nnodes nodes --node_rank=rank --master_addr master.