taoztw / NumberTest

数字翻译错误率

check思路：

1. 生成数字的所有写法
2. python in关键字判断（lower）
3. 判断句子数字旁是否有其他数字。若有则不通过。

Introduction

This repository contains the code used for the paper As Easy as 1, 2, 3: Behavioural Testing of NMT Systemsfor Numerical Translation in ACL 2021 Findings.

Citing

@inproceedings{Wang2021ACLFinding,
  author    = {Jun Wang and
               Chang Xu and
               Francisco Guzm{\'{a}}n and
               Ahmed El{-}Kishky and
               Benjamin I. P. Rubinstein and
               Trevor Cohn},
  editor    = {Chengqing Zong and
               Fei Xia and
               Wenjie Li and
               Roberto Navigli},
  title     = {As Easy as 1, 2, 3: Behavioural Testing of {NMT} Systems for Numerical
               Translation},
  booktitle = {Findings of the Association for Computational Linguistics: {ACL/IJCNLP}
               2021, Online Event, August 1-6, 2021},
  series    = {Findings of {ACL}},
  volume    = {{ACL/IJCNLP} 2021},
  pages     = {4711--4717},
  publisher = {Association for Computational Linguistics},
  year      = {2021}
}