error in modulated_deformable_im2col_cuda": too many resources requested for launch
Stack-it-up opened this issue · comments
Got this error while running the demo on Nvidia TX2:
Solution is to change both .cu files in thirdparty/deform_conv/src to reduce the number of cuda threads.
Namely: from const int CUDA_NUM_THREADS = 1024; to const int CUDA_NUM_THREADS = 512; did the trick. Jetson TX2 has 8gb of vram.
NB: after doing so, rewmember to run again python setup.py develop to compile the deform_conv module