Критические ошибки
metric
ID: criticalerrors
Related Papers
QUARTZ: Quality-Aware Machine Translation
AbstractThis paper presents QUARTZ, QUality-AwaRe machine Translation, a project led by Unbabel which aims at developing machine translation systems that are more robust and produce fewer critical errors. With QUARTZ …...
Robust MT Evaluation with Sentence-level Multilingual Augmentation
AbstractAutomatic translations with critical errors may lead to misinterpretations and pose several risks for the user. As such, it is important that Machine Translation (MT) Evaluation systems are robust to …...
BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluation
AbstractAlthough neural-based machine translation evaluation metrics, such as COMET or BLEURT, have achieved strong correlations with human judgements, they are sometimes unreliable in detecting certain phenomena that can be considered …...