Is cutorch.synchronize() necessary?
ffmpbgrnn opened this issue · comments
Linchao Zhu commented
Hi, I found cutorch.synchronize()
was used in main.lua#L184. Isn't backward()
blocking? And in my experiment, cutorch.synchronize()
will cost much time.
Wojciech Zaremba commented
It was necessary a year ago when I was writing it. Without it code was crashing.
I am not sure if it is necessary now. Torch used to be not the most stable environment.
Linchao Zhu commented
Thank you! @soumith, do you have idea about this?