about the kernel size

[Xiaoyu Shi]

Hi, I find that there is no explicit parameter specifying kernel size in natten.py. How does cuda code get it? By the shape of rpb? Thanks!

[Ali Hassani]

Hello, thanks for your interest.
Yes, RPB is always in the shape of 2 * kernel_size - 1 across the two axes, for every head, therefore it's easy to obtain kernel_size from that.

[Xiaoyu Shi]

Thanks for your prompt reply!

[Ali Hassani]

Closing this due to inactivity. If you still have questions feel free to open it back up.