Temporarily disable expensive text metrics
arnavgarg1 opened this issue · comments
This issue has been created to track that the following text metrics have been temporarily disabled because they are expensive to compute:
- BLEU
- ROUGE
- WordErrorRate
- CharacterErrorRate
We can re-enable them at a different time by allowing users to customize which metrics they want to see during training, leaving the onus on the user to decide how much extra time they are willing to spend training to get more training metrics.
For reference, this is how BLEU and ROUGE scale with a sample of 200 rows over different sequence lengths:
