rasbt

python-machine-learning-book-3rd-edition

The "Python Machine Learning (3rd edition)" book code repository

python_reference

Useful functions, tutorials, and other Python-related things

watermark

An IPython magic extension for printing date and time stamps, version numbers, and hardware information

faster-pytorch-blog

Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy

pytorch-memory-optim

This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.

nn_plus_gzip

Gzip and nearest neighbors for text classification

blog-finetuning-llama-adapters

Supplementary material for "Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to Adapters"

courses

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

comparing-automatic-augmentation-blog

Comparing four automatic image augmentation techniques in PyTorch: AutoAugment, RandAugment, AugMix, and TrivialAugment

gradient-accumulation-blog

Finetuning BLOOM on a single GPU using gradient-accumulation

pytorch-fabric-demo

scipy2022-talk

low-rank-adaptation-blog

b3-basic-batchsize-benchmark

Experiments for the blog post "No, We Don't Have to Choose Batch Sizes As Powers Of 2"

srgan-lightning-blog

Sharing Deep Learning Research Models with Lightning Part 1: Building A Super Resolution App

datapipes-blog

Code for the DataPipes article

try-lion-optimizer

ord-torchhub

Ordinal Regression PyTorch Hub

torchmetrics-blog

Code for "TorchMetrics -- How do we use it, and what's the difference between .update() and .forward()"

whisper

CTGAN

Conditional GAN for generating synthetic tabular data.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, pre-training. Apache 2.0-licensed.

metrics

Machine learning metrics for distributed, scalable PyTorch applications.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

text

Data loaders and abstractions for text and NLP

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

biopandas-feedstock

A conda-smithy repository for biopandas.

bookgiveaway-2022-wordcloud

Word cloud from the results of the book-giveaway

fun_with_git-1

lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch