THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

Home Page:https://THUDM.github.io/SwissArmyTransformer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

No module named localAttention

feihuzhang opened this issue · comments

Thanks for your nice work.
It seems the localAttention lib is missing.

from localAttention import (similar_forward,

Did you use this? https://github.com/zzd1992/Image-Local-Attention
But, I see there are some differences.

Thanks.

please use

git clone https://github.com/Sleepychord/Image-Local-Attention
cd Image-Local-Attention && python setup.py install

I forked the Zhendong's repo and change the implementation for speed up and more functions.