EleutherAI / oslo

OSLO: Open Source for Large-scale Optimization

https://oslo.eleuther.ai

TODO: Deparallelize Pipeline Parallel

ohwi opened this issue 2 years ago · comments

ohwi commented 2 years ago

Describe a TODO feature

Deparallelization of Pipeline Parallel

Assignees

@ohwi