Parallelize training resource generation in the training process
kermitt2 opened this issue · comments
The production of the training data is currently single threaded and really slow for the selection model. A straightforward improvement is to use several workers for this, as this task can be parallelized in a brainless manner...