Vanilla Implementation of MoE training - Expert/Model/Data Parallelism
Repository from Github https://github.comRahulSChand/MoE-Training-VanillaRepository from Github https://github.comRahulSChand/MoE-Training-Vanilla