6块Tesla A100 40G训练会卡住
cherishtttz opened this issue · comments
请问finetune对显存有要求吗？用了6块A100 40G的卡，训练3万多条数据的时候会卡住。
提供完整信息再reopen
beyondguo / LLM-Tuning
Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.
Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.
cherishtttz opened this issue · comments
请问finetune对显存有要求吗？用了6块A100 40G的卡，训练3万多条数据的时候会卡住。
提供完整信息再reopen