How is it compared with Megatron Deepspeed?
allanj opened this issue · comments
- Wondering about the relationship with Megatron Deepspeed
- Are they the same thing? or which one is faster?
The plan is keeping the codebase as minimal as possible with a more explicit and accessible design for users. And at least on par or faster performance than megatron deepspeed