Attention visualization
swordLJP opened this issue · comments
I want to get attention visualization of different expressions like whitch shown in your paper Transfer, can you provide some tools? I am new to Paddle. It's a bit difficult to convert the code from pytorch to paddle.
As we cited in the paper, we used this tool to visualize the attention maps. If you use pytorch for model training, it may not be necessary to convert it to paddle. Their APIs are very similar, and our implementation follows the original ViT codes as in timm.