liucongg / ChatGLM-Finetuning

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型,进行下游具体任务微调,涉及Freeze、Lora、P-tuning、全参微调等

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

local_rank默认设置-1,在执行torch.distributed.get_rank()时报错:RuntimeError: Default process group has not been initialized, please make sure to call init_process_grroup.

dczhangii opened this issue · comments

解决了吗,兄弟