linear-multihead-attention

There are 0 repository under linear-multihead-attention topic.

• kuixu / Linear-Multihead-Attention

  Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)

  attention-mechanismdetrlinear-multihead-attentionlinformertransformer
  Language:Python 69