⚡️ Lightning AI

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.

deep-learning-project-template

Pytorch Lightning code guideline for conferences

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

LitServe

High-throughput serving engine for AI models. Easy to use. Flexible. Enterprise scale.

dl-fundamentals

Deep Learning Fundamentals -- Code material and exercises

litdata

Transform datasets at scale. Optimize datasets for fast AI model training.

tutorials

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.

engineering-class

Lightning Bits: Engineering for Researchers repo

utilities

Common Python utilities and GitHub Actions in Lightning Ecosystem

ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.

forked-pdb

Python pdb for multiple processes

lightning-Habana

Lightning support for Intel Habana accelerators.

probot

lightning-Graphcore

Lightning-multinode-templates

Multinode templates for Pytorch Lightning

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

cloud-training-workshop

.github