Xingyu's repositories
pytorch-beginner
pytorch tutorial for beginners
code-of-learn-deep-learning-with-pytorch
This is code of book "Learn Deep Learning with PyTorch"
chain-of-thought-hub
Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
detectron2
Detectron2 is FAIR's next-generation platform for object detection and segmentation.
flash-attention
Fast and memory-efficient exact attention
float8_experimental
This repository contains the experimental PyTorch native float8 training UX
marlin
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
Megatron-LM
Ongoing research training transformer models at scale
ML-Model-CI
MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying models as cloud services (MLaaS).
mmdetection
OpenMMLab Detection Toolbox and Benchmark
open-llm-foundry
LLM training code for MosaicML foundation models
openai-cookbook
Examples and guides for using the OpenAI API
RedPajama-Data
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
torchshard
TorchShard: Slicing a PyTorch Tensor Into Parallel Shards.