Decoder

This paper describes a decoding algorithm for a syntax-based translation model (Ya- mada and Knight, 2001). The model has been extended to incorporate phrasal translations as presented here. In con- …...

We address a key problem in grapheme-to- phoneme conversion: the ambiguity in map- ping grapheme units to phonemes. Rather than using single letters and phonemes as units, we propose learning …...

Minimum error rate training is often the pre- ferred method for optimizing parameters of statistical machine translation systems. MERT minimizes error rate by using a surrogate rep- resentation of the …...

We present an approach to learning multi-sense word embeddings relying both on monolingual and bilingual information. Our model consists of an encoder, which uses monolingual and bilingual context (i.e. a …...

AbstractThe phrase table is considered to be the main bilingual resource for the phrase-based statistical machine translation (PBSMT) model. During translation, a source sentence is decomposed into several phrases. The …...

AbstractGenerating paraphrases from given sentences involves decoding words step by step from a large vocabulary. To learn a decoder, supervised learning which maximizes the likelihood of tokens always suffers from …...

AbstractThis paper explores the task of answer-aware questions generation. Based on the attention-based pointer generator model, we propose to incorporate an auxiliary task of language modeling to help question generation …...

AbstractWe investigate how to improve quality of low-resource morphological inflection without annotating more data. We examine two methods, language models and data augmentation. We show that the model whose decoder …...

AbstractThe masked language model has received remarkable attention due to its effectiveness on various natural language processing tasks. However, few works have adopted this technique in the sequence-to-sequence models. In …...

AbstractTraditional neural machine translation is limited to the topmost encoder layer’s context representation and cannot directly perceive the lower encoder layers. Existing solutions usually rely on the adjustment of network …...

Recent studies on the analysis of the mul- tilingual representations focus on identifying whether there is an emergence of language- independent representations, or whether a mul- tilingual model partitions its …...

AbstractText style transfer aims to alter the style (e.g., sentiment) of a sentence while preserving its content. A common approach is to map a given sentence to content representation that …...

AbstractGenerating long and coherent text is an important but challenging task, particularly for open-ended language generation tasks such as story generation. Despite the success in modeling intra-sentence coherence, existing generation …...

AbstractRecently, opinion summarization, which is the generation of a summary from multiple reviews, has been conducted in a self-supervised manner by considering a sampled review as a pseudo summary. However, …...

AbstractRelational triple extraction is critical to understanding massive text corpora and constructing large-scale knowledge graph, which has attracted increasing research interest. However, existing studies still face some challenging issues, including …...

AbstractA robust summarization system should be able to capture the gist of the document, regardless of the specific word choices or noise in the input. In this work, we first …...