EleutherAI / oslo

OSLO: Open Source for Large-scale Optimization

https://oslo.eleuther.ai

TODO : Deparallelize expert parallel

scsc0511 opened this issue 2 years ago · comments

scsc0511 commented 2 years ago

Describe a TODO feature

Deparallelize the expert parallelized model

Assignees

scsc0511