Human Parity
metric
ID: humanparity
Related Papers
Document-Level Machine Translation Evaluation Project: Methodology, Effort and Inter-Annotator Agreement
AbstractDocument-level (doc-level) human eval-uation of machine translation (MT) has raised interest in the community after a fewattempts have disproved claims of “human parity” (Toral et al., 2018; Laubli et al.,2018). …...
Statistical Power and Translationese in Machine Translation Evaluation
AbstractThe term translationese has been used to describe features of translated text, and in this paper, we provide detailed analysis of potential adverse effects of translationese on machine translation evaluation. …...
On “Human Parity” and “Super Human Performance” in Machine Translation Evaluation
AbstractIn this paper, we reassess claims of human parity and super human performance in machine translation. Although these terms have already been discussed, as well as the evaluation protocols used …...