how to train with mul gpu?
Aaron2117 opened this issue · comments
it's too long to train on one gpu. how to train with mul gpu? Is it possible to modify only the accerlerate configuration?
support mul gpu now
I noticed that your new train code on dropout prob is [0.1, 0.3]. it' about 20% in whole train phase. But the dropout prob in the paper is 10%.
So, did you found it will be better with 20% dropout than 10% mentioned in the paper?
I noticed that your new train code on dropout prob is [0.1, 0.3]. it' about 20% in whole train phase. But the dropout prob in the paper is 10%. So, did you found it will be better with 20% dropout than 10% mentioned in the paper?
No, just a random setting.