Hunter-DDM / knowledge-neurons

Code for the ACL-2022 paper "Knowledge Neurons in Pretrained Transformers"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question about ig_pred

zhizhou57 opened this issue · comments

hello,
I have a question: why ig_pred is computed but not used in your project. It seems that all the gradients are computed based on golden label. Is there some reason?

We aim to analyze the influence on the probability of the true fact, but not the predicted one, so we use IG w.r.t. the golden label.

ok,thanks