fan2goa1 / Awesome-Attention-Heads

The attention heads in the Transformer architecture possess a variety of capabilities. This is a carefully compiled list that summarizes the diverse functions of the attention heads.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

fan2goa1/Awesome-Attention-Heads Stargazers