Zach Mueller's repositories
minimal-trainer-zoo
Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
Walk-with-fastai-revisited
Source notebook code for the course, stripped of all information. Please consider puchasing the course at https://store.walkwithfastai.com
RAG-Experiments
My learnings (publicly) on RAG systems
import-timer
Pragmatic approach to parsing import profiles for CI's
dependency_checker
A lightweight pythonic way to check if a package's dependencies are out of date
llama-3-8b-self-align
StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation applied to llama 3 8b
presentations
My research posters I have taken to conferences
swe-study-group
Code for the SWE study group
nanotrainer
A small implementation of the HF trainer, rebuilt with an Accelerate core
fastai-2019-pt2-notes
Notes as I speed-run p2 from 2019 out of fastai
hf-model-downloader
Easy way to download model backends from HF
deepspeed-inference-playground
Messing around with DS's TP interface
dotfiles
My dotfiles
gsm8k-ScRel
Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
open-gpu-kernel-modules
NVIDIA Linux open GPU with P2P support
PiPPy
Pipeline Parallelism for PyTorch
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
trl
Train transformer language models with reinforcement learning.
unsloth
2-5X faster 70% less memory QLoRA & LoRA finetuning