jessevig / bertviz

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Home Page:https://towardsdatascience.com/deconstructing-bert-part-2-visualizing-the-inner-workings-of-attention-60a16d86b5c1

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

support for huggingface wav2vec XLSR ?

StephennFernandes opened this issue · comments

Hey does bertviz support visualization for wav2vec XLSR ASR models from huggingface ? where one end is a spectrogram and the other is corresponding transcriptions with attention visualizations of the corresponding text that the audio

Hi @StephennFernandes, thanks for the question! Unfortunately bertviz only supports fully text-based models. Nice idea though.
Best,
Jesse

@jessevig do you know of any other alternatives that i can use to visualize the attention in wav2vec2 ASR models ? any leads you provide would really mean a lot

Sorry @StephennFernandes I don't have any great suggestions there.