⚡️ Lightning AI

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.

deep-learning-project-template

Pytorch Lightning code guideline for conferences

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

dl-fundamentals

Deep Learning Fundamentals -- Code material and exercises

tutorials

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.

litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

engineering-class

Lightning Bits: Engineering for Researchers repo

LitServe

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.

utilities

Common Python utilities and GitHub Actions in Lightning Ecosystem

ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.

forked-pdb

Python pdb for multiple processes

lightning-Habana

Lightning support for Intel Habana accelerators.

probot

lightning-Graphcore

Lightning-multinode-templates

Multinode templates for Pytorch Lightning

lightning-ui

Frontend for Lightning apps and home of the Design System

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

.github

cloud-training-workshop