yygle / performer-attention-tensorflow

An implementation of Performer attention with TensorFlow

performer-attention-tensorflow

An implementation of Performer attention with TensorFlow

Usage

Refer to functionfast_attentionintf_performer.py
Compare Performer-tf with original implementation(Performer-jax) and vanilla attention, please refer to performer_test.ipynb