TER

We introduce a novel evaluation scheme for the human evaluation of different machine translation systems. Our method is based on direct comparison of two sentences at a time by human …...

Recently, confusion network decoding has been applied in machine translation system combination. Due to errors in the hypoth- esis alignment, decoding may result in un- grammatical combination outputs. This pa- …...

We explored novel automatic evaluation measures for machine translation output oriented to the syntactic structure of the sentence: the BLEU score on the detailed Part-of-Speech (POS) tags as well as …...

This paper introduces a new statistical pre- processing model for Rule-Based Machine Translation (RBMT) systems. We train a Statistical Machine Translation (SMT) system using monolingual corpora. This model can transform …...

Automatic evaluation of Machine Translation (MT) quality is essential to developing high- quality MT systems. Various evaluation met- rics have been proposed, and BLEU is now used as the de …...

This paper proposes a novel method for long distance, clause-level reordering in statistical machine translation (SMT). The proposed method separately translates clauses in the source sentence and recon- structs the …...

AbstractErrors in machine translations of English-Iraqi Arabic dialogues were analyzed at two different points in the systems? development using HTER methods to identify errors and human annotations to refine TER …...

The problem of language model adaptation in statistical machine translation is consid- ered. A mixture of language models is employed, which is obtained by clustering the bilingual training data. Unsupervised …...

Translation systems are generally trained to optimize BLEU, but many alternative metrics are available. We explore how optimizing toward various automatic evaluation metrics (BLEU, METEOR, NIST, TER) affects the re- …...

This paper describes the JHU system combi- nation scheme used in WMT-11. The JHU system combination is based on confusion network alignment, and inherited the frame- work developed by (Karakos …...

Long-distance reordering remains one of the biggest challenges facing machine translation. We derive soft constraints from the source de- pendency parsing to directly address the re- ordering problem for the …...

RWTH participated in the System Combi- nation task of the Sixth Workshop on Sta- tistical Machine Translation (WMT 2011). For three language pairs, we combined 6 to 14 systems into …...

We introduce the first fully automatic, fully seman- tic frame based MT evaluation metric, MEANT, that outperforms all other commonly used auto- matic metrics in correlating with human judgment on …...

We describe the systems developed by the team of the Qatar Computing Research Insti- tute for the WMT12 Shared Translation Task. We used a phrase-based statistical machine translation model with …...

In this paper, we propose a novel semantic cohesion model. Our model utilizes the predicate- argument structures as soft constraints and plays the role as a reordering model in the …...

This paper describes the UPC participation in the WMT 12 evaluation campaign. All sys- tems presented are based on standard phrase- based Moses systems. Variations adopted sev- eral improvement techniques …...

In this paper, we propose a novel re- ordering model based on sequence label- ing techniques. Our model converts the reordering problem into a sequence label- ing problem, i.e. a …...

Automatically clustering words from a mono- lingual or bilingual training corpus into classes is a widely used technique in statisti- cal natural language processing. We present a very simple and …...

This paper describes the joint submis- sion of the QUAERO project for the German→English translation task of the ACL 2013 Eighth Workshop on Statisti- cal Machine Translation (WMT 2013). The …...

We present an iterative technique to gener- ate phrase tables for SMT, which is based on force-aligning the training data with a modified translation decoder. Differ- ent from previous work, …...

AbstractThis paper presents a Japanese-to-English statistical machine translation system specialized for patent translation. Patents are practically useful technical documents, but their translation needs different efforts from general-purpose translation. There are …...

This paper describes the LAYERED met- ric which is used for the shared WMT’14 metrics task. Various metrics exist for MT evaluation: BLEU (Papineni, 2002), ME- TEOR (Alon Lavie, 2007), …...

Most of the widely-used automatic evaluation metrics consider only the local fragments of the references and translations, and they ignore the evaluation on the syntax level. Current syntax- based evaluation …...

This work presents two different trans- lation models using recurrent neural net- works. The first one is a word-based ap- proach using word alignments. Second, we present phrase-based translation mod- …...

Post-editing the output of a statistical machine translation (SMT) system to obtain high-quality translation has become an increasingly common application of SMT, which henceforth we re- fer to as post-editing-based …...

Compared to tree grammars, graph gram- mars have stronger generative capacity over structures. Based on an edge re- placement grammar, in this paper we pro- pose to use a synchronous …...

We introduce pre-post-editing, possibly the most basic form of interactive trans- lation, as a touch-based interaction with iteratively improved translation hypothe- ses prior to classical post-editing. We re- port simulated …...

AbstractIn this paper, we propose a novel neural approach for paraphrase generation. Conventional paraphrase generation methods either leverage hand-written rules and thesauri-based alignments, or use statistical machine learning principles. To …...

AbstractWe present CHARCUT, a character-based machine translation evaluation metric derived from a human-targeted segment difference visualisation algorithm. It combines an iterative search for longest common substrings between the candidate and …...

This paper describes Oregon State Uni- versity’s submissions to the shared WMT’17 task “multimodal translation task I”. In this task, all the sentence pairs are image captions in different languages. …...

In this paper, we attempt to improve Statistical Machine Translation (SMT) systems between Czech, Latvian and English in WNT’17 News translation task. We also participated in the Biomedical task and …...

For efficiency considerations, state-of-the- art neural machine translation (NMT) re- quires the vocabulary to be restricted to a limited-size set of several thousand sym- bols. This is highly problematic when …...

We investigate different strategies for combining quality estimation (QE) and automatic post- editing (APE) to improve the output of machine translation (MT) systems. The joint contribu- tion of the two …...

AbstractTranslation memories (TM) and machine translation (MT) both are potentially useful resources for professional translators, but they are often still used independently in translation workflows. As translators tend to have …...

AbstractIn this paper we present an analysis of the two most prominent methodologies used for the human evaluation of MT quality, namely evaluation based on Post-Editing (PE) and evaluation based …...

AbstractGenerating high-quality paraphrases is a fundamental yet challenging natural language processing task. Despite the effectiveness of previous work based on generative models, there remain problems with exposure bias in recurrent …...

AbstractIncremental domain adaptation, in which a system learns from the correct output for each input immediately after making its prediction for that input, can dramatically improve system performance for interactive …...

AbstractWe present the results of the 6th round of the WMT task on MT Automatic Post-Editing. The task consists in automatically correcting the output of a “black-box” machine translation system …...

AbstractWe report the results of the first edition of the WMT shared task on chat translation. The task consisted of translating bilingual conversational text, in particular customer support chats for …...

AbstractThis paper describes POSTECH-ETRI’s submission to WMT2020 for the shared task on automatic post-editing (APE) for 2 language pairs: English-German (En-De) and English-Chinese (En-Zh). We propose APE systems based on …...

AbstractAutomatic post-editing (APE) models are usedto correct machine translation (MT) system outputs by learning from human post-editing patterns. We present the system used in our submission to the WMT’21 Automatic …...

AbstractNeural chat translation aims to translate bilingual conversational text, which has a broad application in international exchanges and cooperation. Despite the impressive performance of sentence-level and context-aware Neural Machine Translation …...

AbstractThe neural machine translation approach has gained popularity in machine translation because of its context analysing ability and its handling of long-term dependency issues. We have participated in the WMT21 …...

AbstractThe Transformer model is the state-of-the-art in Machine Translation. However and in general and neural translation models often under perform on language pairs with insufficient training data. As a consequence …...

AbstractThis paper describes IIT Bombay’s submission to the WMT22 Automatic Post-Editing (APE) shared task for the English-Marathi (En-Mr) language pair. We follow the curriculum training strategy to train our APE …...

AbstractNon-autoregressive approaches aim to improve the inference speed of translation models by only requiring a single forward pass to generate the output sequence instead of iteratively producing each predicted token. …...

AbstractRecent studies in Multimodal Machine Translation (MMT) have explored the use of visual information in a multimodal setting to analyze its redundancy with textual information. The aim of this work …...

AbstractIncorporating personal preference is crucial in advanced machine translation tasks. Despite the recent advancement of machine translation, it remains a demanding task to properly reflect personal style. In this paper, …...

AbstractThe paper reports on the creation, annotation and curation of the MT@BZ corpus, a bilingual (Italian–South Tyrolean German) corpus of machine-translated legal texts from the officially multilingual Province of Bolzano, …...