SHI-Labs / Neighborhood-Attention-Transformer

Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Some comparisons against Deformable Attention

haiphamcse opened this issue · comments

Hi there, thank you for the wonderful work on NATTEN! I want to ask about what advantages Neighbor Attention has over some other mechanisms like Deformable Attention in DETR. Thank you