rasbt

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

ml-engineering

Machine Learning Engineering Open Book

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

pytorch-grad-cam

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

marimo

A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

courses

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

phoenix

AI Observability & Evaluation

battery

CLI/GUI for managing the battery charging status for Apple silicon (M1, M32, M3) Macs

lectures

Material for gpu-mode lectures

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

SimpleTuner

A general fine-tuning kit geared toward diffusion models.

ml-retreat

Machine Learning Journal for Intermediate to Advanced Topics.

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

hlb-CIFAR10

Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)

nanoT5

Fast & Simple repository for pre-training and fine-tuning T5-style models

LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

litdata

Transform datasets at scale. Optimize datasets for fast AI model training.

ml-road-map

The most streamlined road map to learn ML fundamentals for free.

sheeprl

Distributed Reinforcement Learning accelerated by Lightning Fabric

cookie

Scientific Python Library Development Guide and Cookiecutter

dora

Implementation of DoRA

neurips_llm_efficiency_challenge

NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day

TabularBenchmarks

cffconvert

Command line program to validate and convert CITATION.cff files.

graphml-class

Full Stack Graph Machine Learning: Theory, Practice, Tools and Techniques

NER_decoder

Named Entity Recognition with an decoder-only (autoregressive) LLM using HuggingFace

LLMs-for-RecSys

Finetune a pre-trained GPT-2 model to generate personalized product recommendations for users, based on product reviews and metadata

Training-Studio_app

Lightning HPO & Training Studio App

bskycheck