Giters

jessevig / bertviz

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Home Page:https://towardsdatascience.com/deconstructing-bert-part-2-visualizing-the-inner-workings-of-attention-60a16d86b5c1

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Image & Text attention

SuryaThiru opened this issue · comments

commented

I'm looking to visualize the attention heads of models like layoutlmv3 that taken in both the text tokens and image inputs in a meaningful way. Is there a way I can do this with bertviz?

Thank you!

commented

Hi @SuryaThiru there may be a way to extend it somehow with the patch embeddings, but it isn't something I've looked at in detail. Sorry not to be more helpful here.