Add data loading time in log
XinDongol opened this issue · comments
It will be very helpful to have data loading time in log to understand the bottleneck
huggingface / nanotron
Minimalistic large language model 3D-parallelism training
Minimalistic large language model 3D-parallelism training
XinDongol opened this issue · comments
It will be very helpful to have data loading time in log to understand the bottleneck