EleutherAI / oslo

OSLO: Open Source for Large-scale Optimization

https://oslo.eleuther.ai

TODO: Test TP + PP

hyunwoongko opened this issue 2 years ago · comments

Kevin Ko commented 2 years ago

Describe a TODO feature

Test TP + PP on 4 GPus

Assignees

@hyunwoongko @ohwi