Giters

asokraju / makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This repository is not active

About

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

License:MIT License

Languages

Language:Jupyter Notebook 96.2%Language:Python 3.8%