NIST
Related Papers
Applications of Automatic Evaluation Methods to Measuring a Capability of Speech Translation System
The main goal of this paper is to pro- pose automatic schemes for the trans- lation paired comparison method. This method was proposed to precisely eval- uate a speech translation …...
Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics
Following the recent adoption by the machine translation community of automatic evalua- tion using the BLEU/NIST scoring process, we conduct an in-depth study of a similar idea for evaluating summaries. …...
A Unified Approach in Speech-to-Speech Translation: Integrating Features of Speech recognition and Machine Translation
Based upon a statistically trained speech translation system, in this study, we try to combine distinctive features derived from the two modules: speech recognition and statistical machine translation, in a …...
Machine Translation Using Probabilistic Synchronous Dependency Insertion Grammars
Syntax-based statistical machine transla- tion (MT) aims at applying statistical models to structured data. In this paper, we present a syntax-based statistical ma- chine translation system based on a prob- …...
NUT-NTT Statistical Machine Translation System for IWSLT 2005
In this paper, we present a novel distortion model for phrase-based statistical machine translation. Unlike the pre- vious phrase distortion models whose role is to simply penal- ize nonmonotonic alignments[1, …...
Morpho-syntactic Information for Automatic Error Analysis of Statistical Machine Translation Output
Evaluation of machine translation output is an important but difficult task. Over the last years, a variety of automatic evalua- tion measures have been studied, some of them like Word …...
Automatic Evaluation of Translation Quality for Distant Language Pairs
Automatic evaluation of Machine Translation (MT) quality is essential to developing high- quality MT systems. Various evaluation met- rics have been proposed, and BLEU is now used as the de …...
The Best Lexical Metric for Phrase-Based Statistical MT System Optimization
Translation systems are generally trained to optimize BLEU, but many alternative metrics are available. We explore how optimizing toward various automatic evaluation metrics (BLEU, METEOR, NIST, TER) affects the re- …...
Translation Model Adaptation by Resampling
The translation model of statistical ma- chine translation systems is trained on par- allel data coming from various sources and domains. These corpora are usually con- catenated, word alignments are …...
Fully Automatic Semantic MT Evaluation
We introduce the first fully automatic, fully seman- tic frame based MT evaluation metric, MEANT, that outperforms all other commonly used auto- matic metrics in correlating with human judgment on …...
The TALP-UPC phrase-based translation systems for WMT12: Morphology simplification and domain adaptation
This paper describes the UPC participation in the WMT 12 evaluation campaign. All sys- tems presented are based on standard phrase- based Moses systems. Variations adopted sev- eral improvement techniques …...
The TALP-UPC Phrase-Based Translation Systems for WMT13: System Combination with Morphology Generation, Domain Adaptation and Corpus Filtering
This paper describes the TALP participa- tion in the WMT13 evaluation campaign. Our participation is based on the combi- nation of several statistical machine trans- lation systems: based on standard …...
Application of Prize based on Sentence Length in Chunk-based Automatic Evaluation of Machine Translation
As described in this paper, we pro- pose a new automatic evaluation met- ric for machine translation. Our met- ric is based on chunking between the reference and candidate translation. …...
Bilingual Sentiment Consistency for Statistical Machine Translation
In this paper, we explore bilingual sentiment knowledge for statistical machine translation (SMT). We propose to explicitly model the consistency of sentiment between the source and target side with a …...
Translation errors from English to Portuguese: an annotated corpus
AbstractAnalysing the translation errors is a task that can help us finding and describing translation problems in greater detail, but can also suggest where the automatic engines should be improved. …...
Incorporating Discrete Translation Lexicons into Neural Machine Translation
Neural machine translation (NMT) often makes mistakes in translating low-frequency content words that are essential to understand- ing the meaning of the sentence. We propose a method to alleviate this …...
Syntax-based Multi-system Machine Translation
AbstractThis paper describes a hybrid machine translation system that explores a parser to acquire syntactic chunks of a source sentence, translates the chunks with multiple online machine translation (MT) system …...
Multi-layer Representation Fusion for Neural Machine Translation
AbstractNeural machine translation systems require a number of stacked layers for deep models. But the prediction depends on the sentence representation of the top-most layer with no access to low-level …...
Neural Machine Translation with Reordering Embeddings
AbstractThe reordering model plays an important role in phrase-based statistical machine translation. However, there are few works that exploit the reordering information in neural machine translation. In this paper, we …...
Unsupervised Neural Machine Translation with Future Rewarding
AbstractIn this paper, we alleviate the local optimality of back-translation by learning a policy (takes the form of an encoder-decoder and is defined by its parameters) with future rewarding under …...
The SAFE-T Corpus: A New Resource for Simulated Public Safety Communications
AbstractWe introduce a new resource, the SAFE-T (Speech Analysis for Emergency Response Technology) Corpus, designed to simulate first-responder communications by inducing high vocal effort and urgent speech with situational background …...