glassroom / heinsen_attention

Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)

http://arxiv.org/abs/2404.05843

Geek Repo

Github PK Tool