Question about average_frames and reduction parmas

Question

Question about average_frames and reduction parmas

wl-junlin opened this issue 3 years ago · comments

I want to have a stable loss which is rubust to labels_lengths when training.
What value should I pass to this two parmas?

What's more, what is the approximate relationship between loss and actual wer?
For example, if I want a wer aroud 0.5. How much should be the value of the loss?

Ivan Sorokin · Answer 1 · Mon Sep 13 2021 03:34:36 GMT+0800 (China Standard Time)

You shouldn't average over frames. If I remember correctly, theoretically it doesn't make sense. The loss is calculated for the entire utterance.

There is no a direct link between the RNN-T loss value and WER. I think a good analogue would be the negative log-likelihood and the accuracy of a classifier.