Прямые оценки

Character n-gram F-score (CHRF) shown to correlate very well with hu-is man relative rankings of different machine translation outputs, especially for morpho- logically rich target languages. However, its relation with …...

AbstractDevising metrics to assess translation quality has always been at the core of machine translation (MT) research. Traditional automatic reference-based metrics, such as BLEU, have shown correlations with human judgements …...

AbstractWe present COMET, a neural framework for training multilingual machine translation evaluation models which obtains new state-of-the-art levels of correlation with human judgements. Our framework leverages recent breakthroughs in cross-lingual …...

AbstractIn this paper, we present the joint contribution of Unbabel and IST to the WMT 2022 Metrics Shared Task. Our primary submission – dubbed COMET-22 – is an ensemble between …...

AbstractWe report the results of the WMT 2022 shared task on Quality Estimation, in which the challenge is to predict the quality of the output of neural machine translation systems …...