Машиналық аударма метрикалары

metric ID: mtmetrics

Related Papers

Machine Translation Evaluation with Textual Entailment Features

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

We present two regression models for the prediction of pairwise preference judgments among MT hy- potheses. Both models are based on feature sets that are motivated by textual entailment and …...

27003

Re-examining Machine Translation Metrics for Paraphrase Identification

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

We propose to re-examine the hypothesis that automated metrics developed for MT evalu- ation can prove useful for paraphrase iden- tification in light of the significant work on the development …...

23950

VERTa: Facing a Multilingual Experience of a Linguistically-based MT Evaluation

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

AbstractThere are several MT metrics used to evaluate translation into Spanish, although most of them use partial or little linguistic information. In this paper we present the multilingual capability of …...

17097

Incorporate Semantic Structures into Machine Translation Evaluation via UCCA

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractCopying mechanism has been commonly used in neural paraphrasing networks and other text generation tasks, in which some important words in the input sequence are preserved in the output sequence. …...

27544

Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractNeural Machine Translation (NMT) currently exhibits biases such as producing translations that are too short and overgenerating frequent words, and shows poor robustness to copy noise in training data or …...

8856

Disentangling Uncertainty in Machine Translation Evaluation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractTrainable evaluation metrics for machine translation (MT) exhibit strong correlation with human judgements, but they are often hard to interpret and might produce unreliable scores under noisy or out-of-domain data. …...

30297

Robust MT Evaluation with Sentence-level Multilingual Augmentation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractAutomatic translations with critical errors may lead to misinterpretations and pose several risks for the user. As such, it is important that Machine Translation (MT) Evaluation systems are robust to …...

27531

Extrinsic Evaluation of Machine Translation Metrics

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractAutomatic machine translation (MT) metrics are widely used to distinguish the quality of machine translation systems across relatively large test sets (system-level evaluation). However, it is unclear if automatic metrics …...

37856