Multi-GPU support?
deeptek012 opened this issue · comments
Hi @Confusezius ,
Thanks for the great work! It's really helpful. Now I have a large dataset to train, and I wonder if more than 1 GPU is supported? I saw you mentioned use_data_parallel, and I saw some implementation in misc.py. But I didn't see how to turn it on through parameter.py and main.py. Could you help me with that?
Thanks a lot!
HI @deeptek012,
thanks for the kind words! I did use data-parallel during the inception (hence the flag), but removed it for ease of use and prototyping at some point. Technically, it should be quite straightforward to re-incorporate it by wrapping dataloaders & models into the corresponding PyTorch Wrappers, but unfortunately, the current version of the code does not provide it.
Got it. Thanks a lot!