Get CI testing 2 gpu config
dlwh opened this issue · comments
the machine should support us running tests on two gpus (under deepspeed), so we should do that.
Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging Face 🤗 Transformers.
dlwh opened this issue · comments
the machine should support us running tests on two gpus (under deepspeed), so we should do that.