desire2020 / pytorch_memory_efficient_attention_with_learnable_bias

Implements Memory Efficient Attention in plain pytorch. Added support for (learnable!) biases.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

desire2020/pytorch_memory_efficient_attention_with_learnable_bias Issues

No issues in this repository yet.