Paweł Pyrek's starred repositories
cs-video-courses
List of Computer Science courses with video lectures.
annotated_deep_learning_paper_implementations
🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
pytorch-lightning
Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
ultralytics
NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite
ML-From-Scratch
Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.
Megatron-LM
Ongoing research training transformer models at scale
DeepSpeedExamples
Example models using DeepSpeed
efficient-kan
An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
torchtitan
A native PyTorch Library for large model training
FusedFourierKAN
C++ and Cuda ops for fused FourierKAN