FMInference / H2O

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FMInference/H2O Stargazers