Dicardo Xue's starred repositories
FlexTensor
Automatic Schedule Exploration and Optimization Framework for Tensor Computations
brainstorm
Compiler for Dynamic Neural Networks
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
xv6-labs-2022-solutions
MIT 6.828 (6.S081) (6.1810) xv6-labs-2022 实验的答案和解析
YHs_Sample
Yinghan's Code Sample
LLaMA-Megatron
A LLaMA1/LLaMA12 Megatron implement.
gradient-checkpointing
Make huge neural nets fit in memory
Megatron-LM
Ongoing research training transformer models at scale
torchgpipe
A GPipe implementation in PyTorch
LLMSys-PaperList
Large Language Model (LLM) Systems Paper List
TurboTransformers
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
FasterTransformer
Transformer related optimization, including BERT, GPT
pytorch-OpCounter
Count the MACs / FLOPs of your PyTorch model.
flashinfer
FlashInfer: Kernel Library for LLM Serving