运行GPT2案例出现RuntimeError: Could not find 'SLURM_PROCID'问题,是必须要装SLURM环境?
ZXM1063694570 opened this issue · comments
ZXM1063694570 commented
Jiarui Fang commented
加一下 --from_torch在启动命令args里。没加默认用slurm启动
Examples of training models with hybrid parallelism using ColossalAI
ZXM1063694570 opened this issue · comments
加一下 --from_torch在启动命令args里。没加默认用slurm启动