janEbert's repositories
PyTorch-VeLO
VeLO optimizer in PyTorch
accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
apex
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BitBLAS
BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
BitMat
An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
flash-attention
Fast and memory-efficient exact attention
gptel
A no-frills ChatGPT client for Emacs
lightning
Deep learning framework to train, deploy, and ship AI products Lightning fast.
litgpt
Load, pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Megatron-LM
Ongoing research training transformer models at scale
mne-python
MNE: Magnetoencephalography (MEG) and Electroencephalography (EEG) in Python
mup
maximal update parametrization (µP)
NeMo
NeMo: a toolkit for conversational AI
pytorch-minimize
Use scipy.optimize.minimize as a PyTorch Optimizer.
Quicksetup-ai
A flexible template, as a quick setup for deep learning projects in pytorch-lightning
safari
Convolutions for Sequence Modeling
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
triton
Development repository for the Triton language and compiler
utilities
Common Python utilities and GitHub Actions in Lightning Ecosystem