The human evaluation results

[Nan Hu]

Hi there,
The work is great and thank you for your code sharing.
Would you share the human evaluation results in the Sec.6 and the script for "evaluate the accuracy of your automatic metrics by treating the human annotations as gold labels."?
Thanks a lot.

[Tianyu Gao]

Hi,

Thanks for your interest in our work! We added the detailed human eval results in human_eval folder.

[Nan Hu]

@gaotianyu1350 Thanks for your reply and update. Could you please also share the script for "evaluate the accuracy of your automatic metrics by treating the human annotations as gold labels", i.e. calculate the citation recall, citation precision, insufficient citations and irrelevant citations metrics? That would be helpful for understanding your work correctly.

[Tianyu Gao]

@howard-yen can you help sharing the script? Thanks!

[howard-yen]

Hi @HuuuNan, I updated the human_eval dir with the script, thanks for your interest in our project!