RPM-Robotics-Lab / sRGB-TIR

Repository for synthetic RGB to Thermal Infrared translation module from "Edge-guided multidomain RGB to TIR translation", ICRA 2023 submission

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Gradients: inf or nan in tensor

SiBensberg opened this issue · comments

Hi,
I used the FLIR dataset to try out the training. From time to time the error above happens and all model parameters are nan's. Could ou observe similiar behaviour?
I fixed it through catching nan values and clipping gradients.

Hello,

I have the same problem right now. I followed your solution however still getting nan values.

Could you please share your codes regarding clipping gradients ?