Why did you divide this term?
sperfu opened this issue · comments
Hi there,
I was reading your code on graphtransformer, I'm kind of curious on the operation shown below. Why did you divide the wV score by the w(or so called 'score' term), I didn't see any terms shown in your equation 4 or equation 9 in the paper. Could you illustrated that?
Thanks
Hi @sperfu, it is part of the softmax term. Please refer to this issue for the pointers to the explanation.