ilyak93 / GAIN-pytorch

This is an implementation of the network proposed in "Guided Attention Inference Network"(K Li 2018) with advanced tweeks on the gradient paths with experiments and their evaluation.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Doubt in training

BRim28 opened this issue · comments

Hi @ilyak93

In the paper, I did not find any details indicating when to calculate the activation loss and the pixel level loss.
Should it happen in every epoch?
What is your go on this and why?

Hi, @BRim28
By activation loss do you mean attention-mining loss ?
Anyway, yeah just compute it as every other loss, like the classification loss.
You can also deduce from the formulas in the paper that the losses are summed,
including the classification loss, that should pretty much everything about when to use them.
Is that clear?
If you look, in both mains (VOC and MedT) I calculate them each epoch.

@ilyak93

Thank you for the clarification.:+1: