pytorch / text

Models, data loaders and abstractions for language processing, powered by PyTorch

Home Page:https://pytorch.org/text

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

BLEU_SCORE weird behaviour

qlemesle opened this issue · comments

❓ Questions and Help

Is it normal that with standard bleu settings if an n_gram isn't in references then the score returned is 0 ?

With default settings (4 n_grams and weights = [0.025] *4)
The candidate : ['Le', 'petit', 'chat', 'moche']
For the reference : ['Le', 'petit', 'chat', 'mignon']
Get a bleu score of 0.

Due to this line in the code :
if min(clipped_counts) == 0:
return 0.0

Is this behaviour normal ?