BlastWind / ml-from-scratch

Self Study

This is for self study

I plan to build the following from scratch in preparation for getting into Mechanistic Interpretability Research.

1. MLP (use Numpy only) for MNIST.
2. Transformer from scratch (Can use PyTorch)
3. PCA, SVD
4. Sparse Encoder (Dictionary Learning)
5. Reinforcement Learning stuff