lcskrishna

nccl-rccl-parser

Tool to run rccl-tests/nccl-tests based on from an application and gather performance.

pt-aten-logger

PyTorch op instrumentor

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

aiter

AI Tensor Engine for ROCm

ao

PyTorch native quantization and sparsity for training and inference

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

ClassyVision

An end-to-end PyTorch framework for image and video classification

cupy

A NumPy-compatible array library accelerated by CUDA

deep-learning-study

DeepLearningExamples

Deep Learning Examples

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

dlrm

An implementation of a deep learning recommendation model (DLRM)

fmwork

FM Benchmarking Framework

hipify_torch

ieee-sps-ml-tutorial

IEEE SPS Machine Learning Training tutorial

lcskrishna.github.io

Megatron-LM

Ongoing research training transformer language models at scale, including: BERT & GPT-2

my-cuda-experiments

my-pytorch-experiments

Contains some of my pytorch experiments and practise

nn-tools

Some useful neural network tools and some deep learning experiments for quick prototyping and testing.

pytorch-autograd-profile-analyzer

reinforcement-dl

sglang

SGLang is a fast serving framework for large language models and vision language models.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

training_results_v0.7

Training v0.7 results

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.

triton-experiments

vision

Datasets, Transforms and Models specific to Computer Vision

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

VMZ

VMZ: Model Zoo for Video Modeling