Encoder
Related Papers
Bilingual Learning of Multi-sense Embeddings with Discrete Autoencoders
We present an approach to learning multi-sense word embeddings relying both on monolingual and bilingual information. Our model consists of an encoder, which uses monolingual and bilingual context (i.e. a …...
Multi-Task Learning with Language Modeling for Question Generation
AbstractThis paper explores the task of answer-aware questions generation. Based on the attention-based pointer generator model, we propose to incorporate an auxiliary task of language modeling to help question generation …...
Unsupervised Neural Text Simplification
AbstractThe paper presents a first attempt towards unsupervised neural text simplification that relies only on unlabeled text corpora. The core framework is composed of a shared encoder and a pair …...
Curriculum Pre-training for End-to-End Speech Translation
AbstractEnd-to-end speech translation poses a heavy burden on the encoder because it has to transcribe, understand, and learn cross-lingual semantics simultaneously. To obtain a powerful encoder, traditional methods pre-train it …...
IGSQL: Database Schema Interaction Graph Based Neural Model for Context-Dependent Text-to-SQL Generation
AbstractContext-dependent text-to-SQL task has drawn much attention in recent years. Previous models on context-dependent text-to-SQL task only concentrate on utilizing historic user inputs. In this work, in addition to using …...
Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation
AbstractThe masked language model has received remarkable attention due to its effectiveness on various natural language processing tasks. However, few works have adopted this technique in the sequence-to-sequence models. In …...
Neural Topic Modeling with Cycle-Consistent Adversarial Training
AbstractAdvances on deep generative models have attracted significant research interest in neural topic modeling. The recently proposed Adversarial-neural Topic Model models topics with an adversarially trained generator network and employs …...
AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER
AbstractNeural methods have been shown to achieve high performance in Named Entity Recognition (NER), but rely on costly high-quality labeled data for training, which is not always available across languages. …...
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads?
Recent studies on the analysis of the mul- tilingual representations focus on identifying whether there is an emergence of language- independent representations, or whether a mul- tilingual model partitions its …...
Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Model
AbstractAspect-based sentiment analysis (ABSA) task consists of three typical subtasks: aspect term extraction, opinion term extraction, and sentiment polarity classification. These three subtasks are usually performed jointly to save resources …...
Self-Supervised Multimodal Opinion Summarization
AbstractRecently, opinion summarization, which is the generation of a summary from multiple reviews, has been conducted in a self-supervised manner by considering a sampled review as a pseudo summary. However, …...
Multi-Figurative Language Generation
AbstractFigurative language generation is the task of reformulating a given text in the desired figure of speech while still being faithful to the original context. We take the first step …...
Ruleformer: Context-aware Rule Mining over Knowledge Graph
AbstractRule mining is an effective approach for reasoning over knowledge graph (KG). Existing works mainly concentrate on mining rules. However, there might be several rules that could be applied for …...
Improving the Robustness of Summarization Systems with Dual Augmentation
AbstractA robust summarization system should be able to capture the gist of the document, regardless of the specific word choices or noise in the input. In this work, we first …...