huggingface / evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Home Page:https://huggingface.co/docs/evaluate

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Error trying to load accuracy metric

madridu opened this issue · comments

I'm trying to train a GPT-2 model using example scripts and I get an error when the scripts tries to load 'accuracy' metric:

evaluate.load("accuracy")

File "/home/carlos/miniconda3/lib/python3.10/site-packages/evaluate/loading.py", line 752, in load
evaluation_instance = evaluation_cls(
TypeError: 'NoneType' object is not callable

I tried to load other metrics and I only get error with accuracy

I've got installed the requirements:

scikit-learn 1.3.dev0
evaluate 0.4.1.dev0

I'm running the run_clm.py script for language modeling.

Is there something I need to install besides scikit and evaluate? Is there something wrong with the library?

Thanks!

I solved reinstalling os, conda and libraries again.

I don't know where it was the error exactly, I was using Ubuntu 22.04 and python 3.10. Working in Ubuntu with python 3.9