yanqiangmiffy / InstructGLM

ChatGLM-6B 指令学习|指令数据|Instruct

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

RuntimeError: torch.cat(): expected a non-empty list of Tensors

hrdxwandg opened this issue · comments

单机多卡运行时报以上错误。请教下这个是啥问题,找了半天没找到原因

@yanqiangmiffy 问下这个啥原因呀?

这个原因就是向量为空,你看看哪里报错的,打印下数据啥的是否有问题,看看有没有空数据

https://blog.csdn.net/fghjbjhgb/article/details/109081561

@hrdxwandg 遇到了相同的问题,请问现在有解决嘛

@hrdxwandg 遇到了相同的问题,请问现在有解决嘛

还没解决

model = lora_utils.insert_lora.get_lora_model(model, lora_config)
换成
model = lora_utils.insert_lora.get_lora_model_loralib(model, lora_config)

model = lora_utils.insert_lora.get_lora_model(model, lora_config) 换成 model = lora_utils.insert_lora.get_lora_model_loralib(model, lora_config)

感谢,确实有效!

感谢!