rasbt

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

deeplearning-models

A collection of various deep learning architectures, models, and tips

python-machine-learning-book

The "Python Machine Learning (1st edition)" book code repository and info resource

mlxtend

A library of extension and helper modules for Python's data analysis and machine learning libraries.

pattern_classification

A collection of tutorials and examples for solving and understanding machine learning and pattern classification tasks

machine-learning-book

Code Repository for Machine Learning with PyTorch and Scikit-Learn

machine-learning-notes

Collection of useful machine learning codes and snippets (originally intended for my personal use)

scipy2023-deeplearning

LLM-workshop-2024

A 4-hour coding workshop to understand how LLMs are implemented and used

MachineLearning-QandAI-book

Machine Learning Q and AI book

pycon2024

Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024

LLM-finetuning-scripts

dora-from-scratch

LoRA and DoRA from Scratch Implementations

cvpr2023

RAGs

RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems

posit2023-python-ml

Workshop materials for posit::conf(2023)

ViT-finetuning-scripts

Vision transformer finetuning scripts

build-nanogpt

Video+code lecture on building nanoGPT from scratch

py-args

Python command line tools as productivity supplements for Posix systems

rasbt

pytorch-lightning

Deep learning framework to train, deploy, and ship AI products Lightning fast.

litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

neurips_llm_efficiency_challenge

NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day

bitsandbytes

8-bit CUDA functions for PyTorch

LitServe

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.

axolotl

Go ahead and axolotl questions

dora

Implementation of DoRA

llm-efficiency-challenge.github.io

Website for NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1 GPU + 1 Day

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.