How do you implement the equation(15) in your paper?
Dorispaopao opened this issue · comments
Dorispaopao commented
And how to consider the gradient backpropgation in your implement?
Xia Li 李夏 commented
For the first question:
I implemented it in the 'train.py'
Line 134 in 9a492d8
Xia Li 李夏 commented
And how to consider the gradient backpropgation in your implement?
For the second question:
I simple cut off the gradients for the A_E and A_M iterations as
Line 227 in 9a492d8
To be honest, there lacks deep exploration of what happens inside the EMA. So EMANet is just a naive exploration on the EM + Attention mechanism. So, I just look forward for more deep analysis by dear followers.