Giters

THU-KEG / MAVEN-ERE

Source code and dataset for EMNLP 2022 paper "MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction".

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Benchmark causal F1, precision and recall on the validation set

insundaycathy opened this issue · comments

commented

Hi, I'm trying to a simple zero-shot method to do causal relation extraction, since there is no gold reference for the test set, I was wondering if you could provide me with a baseline F1, precision and recall performance on the validation set.
Thank you very much

commented

Hi, thanks for your interest in our work. If you want to get the results on the test set, you can submit your predictions to CodaLab following the instructions in README. I cannot recall the exact results on the validation set. If you want reference results, you may rerun the baselines provided in this repo in your environment, which shall be more comparable to your own results.