long-range-arena

There are 1 repository under long-range-arena topic.

lucidrains / Mega-pytorch
Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
artificial-intelligence attention-mechanisms deep-learning exponential-moving-average long-range-arena
Language:Python 202
FutureComputing4AI / Hrrformer
Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)
ember long-range-arena lra malware neuro-symbolic self-attention transformer holographic-reduced-representations hrr hrrformer icml icml-2023
Language:Python 41
FutureComputing4AI / HGConv
HGConv: Holographic Global Convolutional Networks
drebin ember holographic-reduced-representations hrr kaggle long-range-arena malware malware-classification transformers microsoft-malware-classification-challenge
Language:Python 3
lucaslingle / e-lra
Streamlined variant of Long-Range Arena with pinned dependencies, automated data downloads, and deterministic shuffling.
long-context long-range-arena transformers
Language:Python 3
hazdzz / Paramixer
The PyTorch implementation of Paramixer.
long-range-arena pytorch transformer
Language:Python