Visualize attention results

Question

sandeepbhutani304 opened this issue 3 years ago · comments

Can we create a heatman by using this attention code. I want to visualize the relation between input and output tokens, learnt by this attention

stale · Answer 1 · Wed Jun 23 2021 01:51:08 GMT+0800 (China Standard Time)

Is this still relevant? If so, what is blocking it? Is there anything you can do to help move it forward?

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

Sandeep Bhutani · Answer 2 · Wed Jun 23 2021 01:53:15 GMT+0800 (China Standard Time)

no one to answer?

stale · Answer 3 · Wed Jul 21 2021 09:29:23 GMT+0800 (China Standard Time)

Is this still relevant? If so, what is blocking it? Is there anything you can do to help move it forward?

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.