Articles

This paper describes LIMSI participation to the WMT’14 Shared Task on Qual- ity Estimation; we took part to the word- level quality estimation task for English to Spanish translations. Our system re- lies on a random forest classifier, an en- semble method that has been shown to be very competitive …...

This paper presents the use of consensus among Machine Translation (MT) systems for the WMT14 Quality Estimation shared task. Consensus is explored here by com- paring the MT system output against sev- eral alternative machine translations using standard evaluation metrics. Figures ex- tracted from such metrics are used as fea- …...

This paper describes our Word-level QE system for WMT 2014 shared task on Spanish - English pair. Compared to WMT 2013, this year’s task is different due to the lack of SMT setting information and additional resources. We report how we overcome this challenge to retain most of the important …...

We describe the DCU-MIXED and DCU- SVR submissions to the WMT-14 Quality Estimation task 1.1, predicting sentence- level perceived post-editing effort. Fea- ture design focuses on target-side features as we hypothesise that the source side has little effect on the quality of human trans- lations, which are included in task …...

This paper describes the joint submission of Fondazione Bruno Kessler, Universitat Polit`ecnica de Val`encia and University of Edinburgh to the Quality Estimation tasks of the Workshop on Statistical Machine Translation 2014. We present our submis- sions for Task 1.2, 1.3 and 2. Our systems ranked first for Task 1.2 and …...

We use referential translation machines (RTM) for quality estimation of translation outputs. RTMs are a computational model for identifying the translation acts between any two data sets with respect to interpre- tants selected in the same domain, which are effective when making monolingual and bilingual similarity judgments. RTMs achieve top …...

We describe our systems for the WMT14 Shared Task on Quality Estimation (sub- tasks 1.1, 1.2 and 1.3). Our submissions use the framework of Multi-task Gaus- sian Processes, where we combine multi- ple datasets in a multi-task setting. Due to the large size of our datasets we also ex- periment …...

This paper presents the results of the WMT14 Metrics Shared Task. We asked participants of this task to score the outputs of the MT systems involved in WMT14 Shared Translation Task. We col- lected scores of 23 metrics from 12 re- search groups. In addition to that we com- puted …...

Scrambling is acceptable reordering of verb arguments in languages such as Japanese and German. In automatic eval- uation of translation quality, BLEU is the de facto standard method, but BLEU has only very weak correlation with hu- man judgements in case of Japanese-to- English/English-to-Japanese translations. Therefore, alternative methods, IMPACT and …...

Previous studies of the effect of word alignment on translation quality in SMT generally explore link level metrics only and mostly do not show any clear connec- tions between alignment and SMT qual- ity. In this paper, we specifically inves- tigate the impact of word alignment on two pre-reordering tasks …...

Randomized methods of significance test- ing enable estimation of the probability that an increase in score has occurred sim- ply by chance. In this paper, we examine the accuracy of three randomized meth- ods of significance testing in the context of machine translation: paired bootstrap resampling, bootstrap resampling and ap- …...

This paper explores a number of simple and effective techniques to adapt statisti- cal machine translation (SMT) systems in the medical domain. Comparative exper- iments are conducted on large corpora for six language pairs. We not only compare each adapted system with the baseline, but also combine them to further …...

In this paper we describe experiments on predicting HTER, as part of our submis- sion in the Shared Task on Quality Esti- mation, in the frame of the 9th Workshop on Statistical Machine Translation. In our experiment we check whether it is possi- ble to achieve better HTER prediction by …...

This paper describes LIMSI’s submission to the first medical translation task at WMT’14. We report results for English- French on the subtask of sentence trans- lation from summaries of medical ar- ticles. Our main submission uses a combination of NCODE (n-gram-based) and MOSES (phrase-based) output and continuous-space language models used …...

This paper describes the Dublin City University terminology translation system used for our participation in the query translation subtask in the medical trans- lation task in the Workshop on Statisti- cal Machine Translation (WMT14). We deployed six different kinds of terminol- ogy extraction methods, and participated in three different tasks: …...

This paper presents the participation of the Charles University team in the WMT 2014 Medical Translation Task. Our sys- tems are developed within the Khresmoi project, a large integrated project aim- ing to deliver a multi-lingual multi-modal search and access system for biomedical information and documents. Being in- volved in …...

This paper describes adapting statistical machine translation (SMT) systems to medical domain using in-domain and general-domain data as well as web- crawled in-domain resources. In order to complement the limited in-domain corpo- ra, we apply domain focused web- crawling approaches to acquire in- domain monolingual data and bilingual lexicon from …...

This paper describes the string-to-tree sys- tems built at the University of Edin- burgh for the WMT 2014 shared trans- lation task. We developed systems for English-German, Czech-English, French- English, German-English, Hindi-English, and Russian-English. This year we improved our English-German system through target-side compound splitting, morphosyntactic constraints, and refine- ments …...

We describe the Manawi1 (�����) sys- tem submitted to the 2014 WMT transla- tion shared task. We participated in the English-Hindi (EN-HI) and Hindi-English (HI-EN) language pair and achieved 0.792 for the Translation Error Rate (TER) score2 for EN-HI, the lowest among the competing systems. Our main innova- tions are …...

This paper describes the AFRL sta- tistical MT system and the improve- ments that were developed during the WMT14 evaluation campaign. As part of these efforts we experimented with a number of extensions to the stan- dard phrase-based model that improve performance on Russian to English and Hindi to English …...