princeton-nlp / LM-BFF

[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

SNLI metrics are not supported in Transformer's glue_compute_metrics module

ramakanth-pasunuru opened this issue · comments

Hi, Great work!

I believe SNLI metrics are not supported in the glue_compute_metrics() module of Transformers library. The line in your code tries to compute the SNLI metrics using the glue_compute_metrics(). I believe it will throw an error. Please check it once. Thanks.

Hi thanks for reporting the bug! We have fixed this and you can try again now.

Great! thanks.