Beomi / InfiniTransformer

Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Home Page:https://arxiv.org/abs/2404.07143

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Beomi/InfiniTransformer Stargazers