Giters

antonio-f / mixture-of-experts-from-scratch

Mixture of Experts from scratch

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

artificial-intelligencefrom-scratchjupyter-notebookmixture-of-expertspythonpytorchsimplesmall-datasettutorialconditional-computationmachine-learningnlpgatingroutingeasyhands-on

Mixture of Experts from scratch

Simple implementation of Mixture of Experts technique.

Also available on Substack.

About

Mixture of Experts from scratch

artificial-intelligencefrom-scratchjupyter-notebookmixture-of-expertspythonpytorchsimplesmall-datasettutorialconditional-computationmachine-learningnlpgatingroutingeasyhands-on

Languages

Language:Jupyter Notebook 100.0%