Noahs-ARK / RFA

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

RFA

Reimplementation of Random Feature Attention using PyTorch and customized CUDA kernels.

Documentation coming soon.

Citation

Please cite as:

@inproceedings{
    peng2021rfa,
    title={Random Feature Attention},
    author={Hao Peng and Nikolaos Pappas and Dani Yogatama and Roy Schwartz and Noah Smith and Lingpeng Kong},
    booktitle={International Conference on Learning Representations},
    year={2021},
}

About


Languages

Language:Python 56.5%Language:Cuda 42.2%Language:C++ 1.3%