Yu Zhang's starred repositories
LLMTest_NeedleInAHaystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
tensor_parallel
Automatically split your PyTorch models on multiple GPUs for training & inference
ByteTransformer
optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
InfiniTransformer
Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
long-context-attention
Sequence Parallel Attention for Long Context LLM Model Training and Inference
Rewrite-the-Stars
[CVPR 2024] Rewrite the Stars
LLM-Inheritune
This is the official repository for Inheritune.
LinearAttentionArena
Here we will test various linear attention designs.
infini-mini-transformer
This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and training code.
gpt-accelera
Simple and efficient pytorch-native transformer training and inference (batched)
GORU-tensorflow
Gated Orthogonal Recurrent Unit implementation in tensorflow
heinsen_attention
Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)