how to handle tokens with 0 or 100% probability

Question

how to handle tokens with 0 or 100% probability

shiffman opened this issue 7 years ago · comments

This is what I'm doing now:

if (word[category].prob < 0.01) word[category].prob = 0.01;
if (word[category].prob > 0.99) word[category].prob = 0.99;

Jacob Foster · Answer 1 · Sun Oct 15 2017 04:16:16 GMT+0800 (China Standard Time)

A basic constraint:

word[category].prob = Math.max(0.01, Math.min(0.99, word[category].prob));

Daniel Shiffman · Answer 2 · Sun Oct 15 2017 04:30:12 GMT+0800 (China Standard Time)

Yes, this would be an improvement over my code! Feel free to implement that. I will leave this open, however, as I'm wondering if there is a different or more appropriate mathematical solution?