VatsaDev's repositories
vatsadev.github.io
website
Language:HTML000
Language:HTMLMIT000
Taurus
Gemini agent like devin
Language:PythonMIT000
BSvGA
Batch_size vs Grad_Accum
Language:Python000
000
layersVdimension
wider layers vs more layers
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
Language:PythonMIT000
Language:Python000
Language:Python000
Language:Python000
fact-interp
Trying out interp and transformers abilities with random facts missing
Language:PythonMIT000
TransformerMath
Can transformers learn math, like patterns?
Language:JavaNOASSERTION000
3d
3d page
Language:JavaScript000
Samplers
Implementing sampling methods and features from HF transformers/llama.cpp/kobold/etc into Nano-GPT
Language:Jupyter NotebookMIT000
Special-topics-logs
Keep track of the stuff I've done for special topics
000
NCPT-Lilith
A retrain of the old nanogpt, but with the lilith optimizer
Language:Python000
NanoPhi-alpha
GPT-2 small trained on phi-like data
curriculum-experiment
testing out a curriculum learning method
Language:Python000
llama2c
pure python llama2c
Language:Python000
Language:Python000
simple-evo
Chickens hunted by Foxes, ML
conway
cellular automata
Language:Python000