linear-transformer

There are 0 repository under linear-transformer topic.

• fudan-zvg / SOFT

  [NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity

  linear-complexitylinear-transformerself-attentionsoftmax-freetransformer
  Language:Python 292

• mjhydri / Singing-Vocal-Beat-Tracking

  This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and tempo.

  beat-trackinghubertlinear-transformermusicmusic-information-retrievalself-supervisedsinging-voicewavlm
  Language:Python 23