EleutherAI / oslo

OSLO: Open Source for Large-scale Optimization

https://oslo.eleuther.ai

pass optimizer parameters

minqukanq opened this issue 2 years ago · comments

Mingu Kang commented 2 years ago

Describe a TODO feature

Passing multiple parameters to ZeroRedundancyOptimizer

Assignees

@minqukanq

Kevin Ko commented 2 years ago

And could you test Zero optimizer wirh fsdp?

Mingu Kang commented 2 years ago

@hyunwoongko I tested it but it didn't solve the issue. :(