/----------------------------------------------------------------------------\
| |
| DELiC4MT |
| Diagnostic Evaluation using Linguistic Checkpoints For Machine Translation |
| |
\----------------------------------------------------------------------------/
VERSION 20130612
DELiC4MT is a piece of software that allows to perform diagnostic evaluation of Machine Translation systems over linguistic checkpoints, i.e. source-language lexical elements and grammatical constructions specified by the user. For more details see our paper in the Credits section.
CHANGELOG
---------
20130612 html output added to Java program (for web application)
20120809 bugfix in FileNGramMatcher.java
20120223 Penalty based on brevity added to Java program
20120207 Improved treetagger_preserving_tokens_and_lines.pl
20121215 Added tutorial
20111213 Added script for filtering checkpoints
20111129 Added scripts for statistical significance, script that wraps all the stages (delic4mt.sh) and a test folder with 3 use cases (English to Dutch, German and Italian)
20110724 First release
CONTENTS
--------
doc/ Documentation, including a tutorial and related papers
evaluate/ Java program that carries out the evaluation on linguistic checkpoints
scripts/ Support scripts
test/ Sample test data
CREDITS
-------
Code by Sudip Kumar Naskar and Antonio Toral
Logo by Pawel Plesniak
If you use DELiC4MT in your research please cite the following paper:
Antonio Toral, Sudip Kumar Naskar, Federico Gaspari, Declan Groves. DELiC4MT: A Tool for Diagnostic MT Evaluation over User-defined Linguistic Phenomena. The Prague Bulletin of Mathematical Linguistics No 98, 2012, pp. 121-131., ISSN 0032-6585, DOI: 10.2478/v10108-012-0014-9.
@Article{pbml-2012-delic4mt,
author = {Antonio Toral and Sudip Kumar Naskar and Federico Gaspari and Declan Groves},
title = {{DELiC4MT: A Tool for Diagnostic MT Evaluation over User-defined Linguistic Phenomena}},
journal = {The Prague Bulletin of Mathematical Linguistics},
issue = {98},
publisher = {Springer Berlin/Heidelberg},
issn = {0032-6585},
pages = {121-132},
year = {2012}
}
CONTACT
-------
For any question or suggestion please contact:
Antonio Toral, Sudip Naskar
atoral, snaskar #-at-# computing dot dcu dot ie