Automatic MT Evaluation
Related Papers
Contextual Bitext-Derived Paraphrases in Automatic MT Evaluation
In this paper we present a novel method for deriving paraphrases during automatic MT evaluation using only the source and reference texts, which are necessary for the evaluation, and word …...
Heterogeneous Automatic MT Evaluation Through Non-Parametric Metric Combinations
Combining different metrics into a single measure of quality seems the most direct and natural way to improve over the quality of individual metrics. Recently, several ap- proaches have been …...
On the Robustness of Syntactic and Semantic Features for Automatic MT Evaluation
Linguistic metrics based on syntactic and semantic information have proven very effective for Automatic MT Evaluation. However, no results have been presented so far on their performance when applied to …...
Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers
AbstractThis paper presents the first large-scale meta-evaluation of machine translation (MT). We annotated MT evaluations conducted in 769 research papers published from 2010 to 2020. Our study shows that practices …...