VatsaDev

NanoPhi-alpha

GPT-2 small trained on phi-like data

Lilith

Using the lilith optimizer on nanogpt

JsLabs

make and store pages in the url, using url vars

TransformerMath

Can transformers learn math, like patterns?

adalite

Testing the adalite optimizer

AdventOfCode

Solving all of advent of code in python

NanoPhi

code for NanoPhi

NCPT-Lilith

A retrain of the old nanogpt, but with the lilith optimizer

Papers

Reading papers and taking notes

todo-fbla

the todo fbla project

USACO

USACO-Qs

vatsadev.github.io

website

2024-robot

3d

3d page

algos

Basic Algo Implements

bare-ngpt

conway

cellular automata

curriculum-experiment

testing out a curriculum learning method

fact-interp

Trying out interp and transformers abilities with random facts missing

floatloss

java

java base

keras-cnn

llama2c

pure python llama2c

monkecompression

opencv-wizardry

Samplers

Implementing sampling methods and features from HF transformers/llama.cpp/kobold/etc into Nano-GPT

skald

Created with StackBlitz ⚡️

Special-topics-logs

Keep track of the stuff I've done for special topics

Taurus

Gemini agent like devin

VatsaDev