Yangyu Zhang's starred repositories
flashinfer
FlashInfer: Kernel Library for LLM Serving
vattention
Dynamic Memory Management for Serving LLMs without PagedAttention
cuda_ioctl_sniffer
Sniff CUDA ioctls
Retrieval_Head
open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
academicpages.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
StreamDiffusion
StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation
LLMSpeculativeSampling
Fast inference from large lauguage models via speculative decoding
ACL2023-Retrieval-LM.github.io
https://acl2023-retrieval-lm.github.io/
generative_agents
Generative Agents: Interactive Simulacra of Human Behavior