How to improve the speed when loading shapenet data?
Be997398715 opened this issue · comments
As image above, I test the loading time of read_pcd file , each file needs about 3~4s , is there any way to improve training process ?
Wish for your reply!
The data is loaded in an asynchronous way. As you can see, the data time is 0, which means the bottleneck of the training process is not data loading.
actactually it is asynchronous，but each minibatch data need to load(here batchsize=32). And I found the minibatch data havent been ready for next training, which means each minibatch train needs at least 8 data, and each data file needs about 3s to read from IO function. I think this is the key peroblem. I hope for your reply.
Please try to use more data loader workers.