There are no diversity metrics in eval_diversity.py

[RyanLiu]

Hi,

Thank you for your source code!

I wonder what the role of eval_diversity.py is, since there are no diversity metrics, like novel words, new sentences in the file. So what is the difference between eval.py and eval_diversity.py?

Thank you
Ryan.

[Shweta Mahajan]

Hi Ryan,
eval_diversity.py creates a numpy file for consensus reranking.
See point 3 under pretrained models and evaluation.

Thanks,
Shweta

[RyanLiu]

Many thanks. I got it!