Loss is too high, and no result output by infer.py

Question

Loss is too high, and no result output by infer.py

PubMedKG opened this issue a year ago · comments

yuch25 commented a year ago

Hi suicao,

I want cite your code for dataset NER, but I don't know why loss is too high, and no result output by infer.py.

I have tried the code for 5 times at least. Could you please check the code?

Thank you very much.

Khoi Nguyen · Answer 1 · Wed Aug 23 2023 20:47:34 GMT+0800 (China Standard Time)

Sorry for the late reply, have you fixed the issue?
It seems to me the p_mask parameter in the forward function of the model messed with the cross entropy loss, you can send p_mask = None from the training loop and the loss would converge.

yuch25 · Answer 2 · Wed Aug 23 2023 22:05:39 GMT+0800 (China Standard Time)

Sorry for the late reply, have you fixed the issue? It seems to me the p_mask parameter in the forward function of the model messed with the cross entropy loss, you can send p_mask = None from the training loop and the loss would converge.

Oh, thank you, it works for me. You are really a cool man!