MT-ComparEval: Graphical evaluation interface for Machine Translation development

Ondrej Klejch, Eleftherios Avramidis, Aljoscha Burchardt, Martin Popel

In: Jan Hajic (Hrsg.). The Prague Bulletin of Mathematical Linguistics (PBML) 104 Seiten 63-74 Charles University in Prague 2015.


The tool described in this article has been designed to help MT developers by implementing a web-based graphical user interface that allows to systematically compare and evaluate various MT engines/experiments using comparative analysis via automatic measures and statistics. The evaluation panel provides graphs, tests for statistical significance and n-gram statistics. We also present a demo server with WMT14 and WMT15 translations.


Weitere Links

mt-compareval.pdf (pdf, 370 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence