lucidrains / coordinate-descent-attention

Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

lucidrains/coordinate-descent-attention Stargazers