Giters

lucidrains / mixture-of-attention

Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

lucidrains/mixture-of-attention Stargazers