stas00

ml-engineering

Machine Learning Engineering Open Book

the-art-of-debugging

The Art of Debugging

ipyexperiments

Automatic GPU+CPU memory profiling, re-use and memory leaks detection using jupyter/ipython experiment containers

ml-ways

ML/DL Math and Method notes

python-tools

Python tools

stas00

git-tools

helper git tools

conda-tools

helper tools for the conda environment

transformers

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

backups

an effort to resist Internet entropy - save useful knowledge

bash-tools

Bash tools

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

accelerate

A simple way to train and use NLP models with multi-GPU, TPU, mixed-precision

NeMo

NeMo: a toolkit for conversational AI

psg

Pocket Survival Guide for Sys Admin - http://psg.skinforum.org/ -

pytorch-lightning

The lightweight PyTorch wrapper for ML researchers. Scale your models. Write less boilerplate

tensorboard-tools

tensorboard tools

tinypar

TP/PP/DP implementation of llama using apex blocks

unix-tools

Miscellaneous tools

bigscience-backup

bitsandbytes

8-bit CUDA functions for PyTorch

GLM-130B-backup

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

m4-logs-backup

M4 experiment logbook

make-tools

make tools

metaseq-backup

Repo for external large-scale work

nccl-tests

NCCL Tests

olm-datasets

Pipeline for pulling and processing online language model pretraining data from the web

SimpleParsing

Simple, Elegant, Typed Argument Parsing with argparse

TransformerSizing