Long latency when loading fft_conv kernel for the first time
sylee0124 opened this issue · comments
The first kernel launch of fft_conv_fwd takes abnormally long time (about 100 sec).
After the first kernel launch it works fine so for training it's not much of an issue but it makes debugging very cumbersome.
Could it be a problem with my ld options?
This is something we experience too - it makes it super annoying to debug...
We're looking into it, but if anyone has suggestions we'd love to hear them!