Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool