allenai / scirepeval

SciRepEval benchmark training and evaluation scripts

allenai/scirepeval Issues

Huggingface Dataset Config Mismatch
Closed 9 months ago2
ValueError when running benchmark
Closed a year ago10
Issue when running training
Closed a year ago1
Unable to run a training with the pl_training script
Closed a year ago3
checksum errors on feed* subsets
Closed a year ago6
corpus_id and doc_id – where do they come from?
Closed a year ago2
Configure S2AND task for ensemble setups: SciNCL + MTL CTRL + Adapters, and SciNCL + Adapters
Closed a year ago2
Configure benchmark for SciNCL Adapters + MTL CTRL
Closed a year ago2
Issues with requirements.txt
Updated a year ago
Error in running the training script
Closed a year ago7
NonMatchingChecksumError for the search benchmark
Closed 2 years ago6
ValueError when running benchmark
Closed a year ago4
"cite_prediction_new" in SciRepEval training data
Closed a year ago2
Issues with examples/retrieval.py
Closed 2 years ago6
openai dependency not listed in requirements
Closed 2 years ago3
S2AND Evaluation: Missing param --emb_suffix
Closed 2 years ago2
Issue with evaluating MeSH
Closed 2 years ago2