AppraiseDev / OCELoT

Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations

Welcome to OCELoT!

OCELoT stands for Open, Competitive Evaluation Leaderboard of Translations. This project started as part of the Fifth Machine Translation Marathon in the Americas, hosted at UMD, College Park, MD, from May 28–June 1, 2019. Project OCELoT aims to create an open platform for competitive evaluation of machine translation output, based on both automatic metrics and human evalation. Code is available from GitHub and shared under an open license.

Getting started

• Installation instructions
• Basic usage notes

License

OCELoT is released under BSD 3-Clause License

Contributors

We are grateful to the following contributors for their support:

• Christian Federmann (Microsoft)
• Roman Grundkiewicz (Microsoft)
• Tom Kocmi (Microsoft)
• Zi-Yi Dou (Carnegie Mellon University)

Acknowledgments

We acknowledge the following licenses and thank the respective authors for making their work available:

• Project compare-mt by NeuLab released under BSD 3-Clause License; you should also read their NAACL19 paper!
• Logo Glyphe Ocelotl (jaguar) by Katepanomegas released on Wikimedia Commons under CC BY 3.0 License