SNLI metrics are not supported in Transformer's glue_compute_metrics module
ramakanth-pasunuru opened this issue · comments
Ramakanth Pasunuru commented
Hi, Great work!
I believe SNLI metrics are not supported in the glue_compute_metrics() module of Transformers library. The line in your code tries to compute the SNLI metrics using the glue_compute_metrics(). I believe it will throw an error. Please check it once. Thanks.
Tianyu Gao commented
Hi thanks for reporting the bug! We have fixed this and you can try again now.
Ramakanth Pasunuru commented
Great! thanks.