upunaprosk / Topology_for_BERT_CoLA

Code for Feature Space Analysis from the paper Acceptability Judgements via Examining the Topology of Attention Maps (EMNLP22)

Analysis of the Feature Space

Code for the Sections 4.3/C.2 of the paper Acceptability Judgements via Examining the Topology of Attention Maps.

Conducted using SHapley Additive exPlanations method introduced by Lundberg and Lee (2017).

Setting: fine-tuned En-BERT + $\textit{TDA}$ features.

• feature_space_analysis_pipeline - Pipeline declaration and hyperparameters search;
• feature_space_analysis_shapley - Principal components interpretation.