nlgknowledge / commonsense

The Commonsense Evaluation Card

Home Page:https://nlgknowledge.github.io/commonsense/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

NLG Commonsense Knowledge

Authors: Miruna-Adriana Clinciu, Dimitra Gkatzia and Saad Mahamood

The Commonsense Evaluation Card

To facilitate reproducibility as well as understanding of the reported work, we have devised the Commonsense Evaluation Card (CEC) which offers authors a guide on how to report evaluations of commonsense-enhanced NLG systems. It can also be used for NLP systems with minor modifications. You can find a CEC FORM at the following link The Commonsense Evaluation Card FORM

Citing

@inproceedings{clinciu-etal-2021-commonsense,
title = "It{'}s Commonsense, isn{'}t it? Demystifying Human Evaluations in Commonsense-Enhanced {NLG} Systems",
author = "Clinciu, Miruna-Adriana and Gkatzia, Dimitra and Mahamood, Saad",
booktitle = "Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval)",
year = "2021"
}

About

The Commonsense Evaluation Card

https://nlgknowledge.github.io/commonsense/


Languages

Language:Jupyter Notebook 87.6%Language:Python 6.4%Language:HTML 6.0%