Giters

glassroom / heinsen_attention

Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)

Home Page:http://arxiv.org/abs/2404.05843

Repository from Github https://github.comglassroom/heinsen_attentionRepository from Github https://github.comglassroom/heinsen_attention

glassroom/heinsen_attention Stargazers