HarderThenHarder / transformers_tasks

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.

Home Page:https://www.zhihu.com/column/c_1451236880973426688

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

多卡训练,无法运行train_multi_gpu.sh

cheney369 opened this issue · comments

sh train_multi_gpu.py之后,控制台出现WARING后无其他信息,几秒后直接跳出。这个是什么原因呢?

root@pt_exp://data/chatglm/chatglm-6B/fine_tuning# sh train_multi_gpu.sh
[09:32:06] WARNING The following values were not passed to accelerate launch and had defaults used instead: root@pt_exp://data/chatglm/chatglm-6B/fine_tuning#

我重新更新了一下bitsandbytes 就可以了