Көптілді нейрондық машиналық аударма
Related Papers
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism
We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only lin- …...
Multilingual Disfluency Removal using NMT
AbstractIn this paper, we investigate a multilingual approach for speech disfluency removal. A major challenge of this task comes from the costly nature of disfluency annotation. Motivated by the fact …...
Effective Strategies in Zero-Shot Neural Machine Translation
AbstractIn this paper, we proposed two strategies which can be applied to a multilingual neural machine translation system in order to better tackle zero-shot scenarios despite not having any parallel …...
KIT’s Multilingual Neural Machine Translation systems for IWSLT 2017
AbstractIn this paper, we present KIT’s multilingual neural machine translation (NMT) systems for the IWSLT 2017 evaluation campaign machine translation (MT) and spoken language translation (SLT) tasks. For our MT …...
Adapting Multilingual NMT to Extremely Low Resource Languages FBK’s Participation in the Basque-English Low-Resource MT Task, IWSLT 2018
AbstractMultilingual neural machine translation (M-NMT) has recently shown to improve performance of machine translation of low-resource languages. Thanks to its implicit transfer-learning mechanism, the availability of a highly resourced language …...
Prompsit’s Submission to the IWSLT 2018 Low Resource Machine Translation Task
AbstractThis paper presents Prompsit Language Engineering’s submission to the IWSLT 2018 Low Resource Machine Translation task. Our submission is based on cross-lingual learning: a multilingual neural machine translation system was …...
A Compact and Language-Sensitive Multilingual Translation Method
AbstractMultilingual neural machine translation (Multi-NMT) with one encoder-decoder model has made remarkable progress due to its simple deployment. However, this multilingual translation paradigm does not make full use of language …...
Massively Multilingual Neural Machine Translation
AbstractMultilingual Neural Machine Translation enables training a single model that supports translation from multiple source languages into multiple target languages. We perform extensive experiments in training massively multilingual NMT models, …...
A Multilingual View of Unsupervised Machine Translation
AbstractWe present a probabilistic framework for multilingual neural machine translation that encompasses supervised and unsupervised setups, focusing on unsupervised translation. In addition to studying the vanilla case where there is …...
Complete Multilingual Neural Machine Translation
AbstractMultilingual Neural Machine Translation (MNMT) models are commonly trained on a joint set of bilingual corpora which is acutely English-centric (i.e. English either as source or target language). While direct …...
Language-aware Interlingua for Multilingual Neural Machine Translation
AbstractMultilingual neural machine translation (NMT) has led to impressive accuracy improvements in low-resource scenarios by sharing common linguistic information across languages. However, the traditional multilingual model fails to capture the …...
An Empirical Investigation of Word Alignment Supervision for Zero-Shot Multilingual Neural Machine Translation
AbstractZero-shot translations is a fascinating feature of Multilingual Neural Machine Translation (MNMT) systems. These MNMT models are usually trained on English-centric data, i.e. English either as the source or target …...
Distributionally Robust Multilingual Machine Translation
AbstractMultilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data …...
Improving Multilingual Translation by Representation and Gradient Regularization
AbstractMultilingual Neural Machine Translation (NMT) enables one model to serve all translation directions, including ones that are unseen during training, i.e. zero-shot translation. Despite being theoretically attractive, current models often …...
Improving Zero-Shot Translation by Disentangling Positional Information
AbstractMultilingual neural machine translation has shown the capability of directly translating between language pairs unseen in training, i.e. zero-shot translation. Despite being conceptually attractive, it often suffers from low output …...
Language Tags Matter for Zero-Shot Neural Machine Translation
Multilingual Neural Machine Translation (MNMT) has aroused widespread interest due to its efficiency. An exciting advantage of MNMT models is that they could also translate between unsupervised (zero-shot) language directions. …...
Learning Language Specific Sub-network for Multilingual Machine Translation
AbstractMultilingual neural machine translation aims at learning a single translation model for multiple languages. These jointly trained models often suffer from performance degradationon rich-resource language pairs. We attribute this degeneration …...
RevCore: Review-Augmented Conversational Recommendation
This work studies the long-standing prob- lems of model capacity and negative interfer- ence in multilingual neural machine transla- tion (MNMT). We use network pruning tech- niques and observe that …...
SGL: Speaking the Graph Languages of Semantic Parsing via Multilingual Translation
AbstractGraph-based semantic parsing aims to represent textual meaning through directed graphs. As one of the most promising general-purpose meaning representations, these structures and their parsing have gained a significant interest …...
Adapting to Non-Centered Languages for Zero-shot Multilingual Translation
AbstractMultilingual neural machine translation can translate unseen language pairs during training, i.e. zero-shot translation. However, the zero-shot translation is always unstable. Although prior works attributed the instability to the domination …...
Adaptive Token-level Cross-lingual Feature Mixing for Multilingual Neural Machine Translation
AbstractMultilingual neural machine translation aims to translate multiple language pairs in a single model and has shown great success thanks to the knowledge transfer across languages with the shared parameters. …...
Addressing Asymmetry in Multilingual Neural Machine Translation with Fuzzy Task Clustering
AbstractMultilingual neural machine translation (NMT) enables positive knowledge transfer among multiple translation tasks with a shared underlying model, but a unified multilingual model usually suffers from capacity bottleneck when tens …...
EAG: Extract and Generate Multi-way Aligned Corpus for Complete Multi-lingual Neural Machine Translation
AbstractComplete Multi-lingual Neural Machine Translation (C-MNMT) achieves superior performance against the conventional MNMT by constructing multi-way aligned corpus, i.e., aligning bilingual training examples from different language pairs when either their …...
Fast Vocabulary Projection Method via Clustering for Multilingual Machine Translation on GPU
AbstractMultilingual Neural Machine Translation has been showing great success using transformer models. Deploying these models is challenging because they usually require large vocabulary (vocab) sizes for various languages. This limits …...
Few-Shot Regularization to Tackle Catastrophic Forgetting in Multilingual Machine Translation
AbstractIncreasing the number of tasks supported by a machine learning model without forgetting previously learned tasks is the goal of any lifelong learning system. In this work, we study how …...
Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation
AbstractMultilingual neural machine translation models are trained to maximize the likelihood of a mix of examples drawn from multiple language pairs. The dominant inductive bias applied to these models is …...
Pre-training Synthetic Cross-lingual Decoder for Multilingual Samples Adaptation in E-Commerce Neural Machine Translation
AbstractAvailability of the user reviews in vernacular languages is helpful for the users to get information regarding the products. Since most of the e-commerce websites allow the reviews in English …...
Unifying the Convergences in Multilingual Neural Machine Translation
AbstractAlthough all-in-one-model multilingual neural machine translation (MNMT) has achieved remarkable progress, the convergence inconsistency in the joint training is ignored, i.e., different language pairs reaching convergence in different epochs. This …...
An Empirical Study of Leveraging Knowledge Distillation for Compressing Multilingual Neural Machine Translation Models
AbstractKnowledge distillation (KD) is a well-known method for compressing neural models. However, works focusing on distilling knowledge from large multilingual neural machine translation (MNMT) models into smaller ones are practically …...
Guiding Zero-Shot Paraphrase Generation with Fine-Grained Control Tokens
AbstractSequence-to-sequence paraphrase generation models often struggle with the generation of diverse paraphrases. This deficiency constrains the viability of leveraging paraphrase generation in different Natural Language Processing tasks. We propose a …...