VITA-Group / ViT-Anti-Oversmoothing

[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How can i visualise the spectrum of the attention maps?

EatonL opened this issue · comments

I really enjoyed your paper, and i would like to know how to get the figure 5 in your paper.I have tried the scipy.signal.freqz function but the results are very different from yours. I would be grateful if you could help me with the code.

commented

Hi Eaton,

Thanks for your interest and sorry for the late reply. I hope the discussion in this thread #1 (comment) could be helpful for you.

Best,
Peihao