Machine Translation Evaluation
Related Papers
MT evaluation: old, new, and recycled
AbstractThe tutorial addresses the issues peculiar to machine translation evaluation, namely the difficulty in determining what constitutes correct translation, and which types of evaluation are the most meaningful for evaluation …...
Teaching machine translation evaluation by assessed project work
The paper describes the use of an assessed independent study project on machine translation evaluation as part of a final-year undergraduate course on machine assisted translation. The advantages and potential …...
Measuring MT Adequacy Using Latent Semantic Analysis
AbstractTranslation adequacy is defined as the amount of semantic content from the source language document that is conveyed in the target language document. As such, it is more difficult to …...
Is my Judge a good One?
AbstractThis paper aims at measuring the reliability of judges in MT evaluation. The scope is two evaluation campaigns from the CESTA project, during which human evaluations were carried out on …...
Evaluating User Preferences in Machine Translation Using Conjoint Analysis
In spite of much ongoing research on ma- chine translation evaluation there is little quantitative work that directly measures users’ intuitive or emotional preferences regarding different types of machine trans- …...
SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
Semantic Textual Similarity (STS) measures the degree of semantic equivalence between two texts. This paper presents the results of the STS pilot task in Semeval. The training data contained 2000 …...
Register-based machine translation evaluation with text classification techniques
This paper presents a novel approach to machine translation evaluation by combining register features – characterised by particular distributions of lexico-grammatical features – with text classification techniques. The goal of …...
Statistical Power and Translationese in Machine Translation Evaluation
AbstractThe term translationese has been used to describe features of translated text, and in this paper, we provide detailed analysis of potential adverse effects of translationese on machine translation evaluation. …...