amulil's starred repositories
EasyAnimate
📺 An End-to-End Solution for High-Resolution and Long Video Generation Based on Transformer Diffusion
build-nanogpt
Video+code lecture on building nanoGPT from scratch
llama3-from-scratch
llama3 implementation one matrix multiplication at a time
Online-RLHF
A recipe for online RLHF.
Llama3-Tutorial
Llama3-Tutorial(XTuner、LMDeploy、OpenCompass)
distilabel
⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.
optimum-quanto
A pytorch quantization backend for optimum
min-max-gpt
Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
gradient-checkpointing
Make huge neural nets fit in memory
Awesome-LLMs-Datasets
Summarize existing representative LLMs text datasets.
Megatron-LM
Ongoing research training transformer models at scale
bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
alignment-handbook
Robust recipes to align language models with human and AI preferences