How to implement locally-windowed temporal self-attention?

Question

How to implement locally-windowed temporal self-attention?

GewelsJI opened this issue a year ago · comments

Thanks for releasing a nice work. Could you provide more details about how to implement locally-windowed temporal self-attention in Spatio-Temporal Transformer? From your original description, it is hard to implement it.

Best.

Hanwen Jiang · Answer 1 · Mon Jun 19 2023 06:47:35 GMT+0800 (China Standard Time)

Thanks for your interest in our work!

Feel free to shoot me an email and I can share the raw code.