VatsaDev

tiny-asic-4bit-matrix-mul

Tiny matrix multiplication ASIC with 4-bit math

JsLabs

make and store pages in the url, using url vars

TPU-Alignment

Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free

AIMO-Competition

llm.c

LLM training in simple, raw C/CUDA

TransformerMath

Can transformers learn math, like patterns?

xVal

Repository for code used in the xVal paper

quiet-star

Code for Quiet-STaR

grok-1

Grok open release

OpenDevin

🐚 OpenDevin: Code Less, Make More

moondream

tiny vision language model

yet-another-applied-llm-benchmark

A benchmark to evaluate language models on questions I've previously asked them to solve.

gemma_pytorch

The official PyTorch implementation of Google's Gemma models

NCPT-Lilith

A retrain of the old nanogpt, but with the lilith optimizer

cramming

Cramming the training of a (BERT-type) language model into limited compute.

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

todo-fbla

the todo fbla project

Lilith

Using the lilith optimizer on nanogpt

opencv-images

FaceRWKV

Course Project for COMP4471 on RWKV

othello_mamba

Evaluating the Mamba architecture on the Othello game

01

The open-source language model computer

quartic-transformer

Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)

RAGatouille

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

aseprite

Animated sprite editor & pixel art tool (Windows, macOS, Linux)

galactic

data cleaning and curation for unstructured text

gptcore

Fast modular code to create and train cutting edge LLMs

2024-Swerve-concept

Describing Swerve functionality, mockup math

mamba.c

Inference of Mamba models in pure C

alphageometry