EleutherAI/lm-evaluation-harness Issues
Cannot load local `mmlu` dataset
Closed 2Missing Tasks in Leaderboard
Updated 2OOM for gpqa on A100
Closed 5Test BBH using local dataset
Closed 4Question about IFEval on LeaderBoard
Updated 1nltk pickle
Updatedmmlu_pro fewshot_config
UpdatedCoQA evaluation
Updatedcall model instead of forward
Closed 5Better Arg Typechecking / Validation
Updated 2mgsm task not working
UpdatedBetter tests for API models
Updated