This repository contains third-party annotations of the iSarcasmEval subtask A test set (Arabic). Each sentence was annotated by five different annotators. The data contains
- Original sarcasm label.
- Original dialect label.
- Assigned sarcasm label.
- Assigned dialect label.
- Annotator's mother dialect.
- The dialects the annotator is familiar with.
- The gender of the annotator.
If you use this data please cite our work:
@inproceedings{abu-farha-magdy-2022-dialects,
title = "The Effect of Arabic Dialect Familiarity on Data Annotation",
author = "Abu Farha, Ibrahim and
Magdy, Walid",
booktitle = "Proceedings of the Seventh Arabic Natural Language Processing Workshop",
month = dec,
year = "2022",
address = "Abu Dhabi, United Arab Emirates",
publisher = "Association for Computational Linguistics",
}