Seq2Seq Model
Related Papers
Generating Descriptions from Structured Data Using a Bifocal Attention Mechanism and Gated Orthogonalization
AbstractIn this work, we focus on the task of generating natural language descriptions from a structured table of facts containing fields (such as nationality, occupation, etc) and values (such as …...
Generating Reasonable and Diversified Story Ending Using Sequence to Sequence Model with Adversarial Training
AbstractStory generation is a challenging problem in artificial intelligence (AI) and has received a lot of interests in the natural language processing (NLP) community. Most previous work tried to solve …...
A Pointer Network Architecture for Context-Dependent Semantic Parsing
Semantic parsing targets at mapping human utterances into structured meaning represen- tations, such as logical forms, programming snippets, SQL queries etc. In this work, we focus on logical form generation, …...
Question-type Driven Question Generation
AbstractQuestion generation is a challenging task which aims to ask a question based on an answer and relevant context. The existing works suffer from the mismatching between question type and …...
Focus-Constrained Attention Mechanism for CVAE-based Response Generation
AbstractTo model diverse responses for a given post, one promising way is to introduce a latent variable into Seq2Seq models. The latent variable is supposed to capture the discourse-level information …...
GM-RKB WikiText Error Correction Task and Baselines
AbstractWe introduce the GM-RKB WikiText Error Correction Task for the automatic detection and correction of typographical errors in WikiText annotated pages. The included corpus is based on a snapshot of …...
Hashtags, Emotions, and Comments: A Large-Scale Dataset to Understand Fine-Grained Social Emotions to Online Topics
AbstractThis paper studies social emotions to online discussion topics. While most prior work focus on emotions from writers, we investigate readers’ responses and explore the public feelings to an online …...
Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction
AbstractWe propose a novel language-independent approach to improve the efficiency for Grammatical Error Correction (GEC) by dividing the task into two subtasks: Erroneous Span Detection (ESD) and Erroneous Span Correction …...
Stronger Baselines for Grammatical Error Correction Using a Pretrained Encoder-Decoder Model
AbstractStudies on grammatical error correction (GEC) have reported on the effectiveness of pretraining a Seq2Seq model with a large amount of pseudodata. However, this approach requires time-consuming pretraining of GEC …...
Topic-driven Ensemble for Online Advertising Generation
AbstractOnline advertising is one of the most widespread ways to reach and increase a target audience for those selling products. Usually having a form of a banner, advertising engages users …...
Translation vs. Dialogue: A Comparative Analysis of Sequence-to-Sequence Modeling
AbstractUnderstanding neural models is a major topic of interest in the deep learning community. In this paper, we propose to interpret a general neural model comparatively. Specifically, we study the …...
Implicit Premise Generation with Discourse-aware Commonsense Knowledge Models
AbstractEnthymemes are defined as arguments where a premise or conclusion is left implicit. We tackle the task of generating the implicit premise in an enthymeme, which requires not only an …...
KILT: a Benchmark for Knowledge Intensive Language Tasks
AbstractChallenging problems such as open-domain question answering, fact checking, slot filling and entity linking require access to large, external knowledge sources. While some models do well on individual tasks, developing …...
Contrastive Learning enhanced Author-Style Headline Generation
AbstractHeadline generation is a task of generating an appropriate headline for a given article, which can be further used for machine-aided writing or enhancing the click-through ratio. Current works only …...
Focus-Driven Contrastive Learning for Medical Question Summarization
AbstractAutomatic medical question summarization can significantly help the system to understand consumer health questions and retrieve correct answers. The Seq2Seq model based on maximum likelihood estimation (MLE) has been applied …...
Semantic-aware Contrastive Learning for More Accurate Semantic Parsing
AbstractSince the meaning representations are detailed and accurate annotations which express fine-grained sequence-level semtantics, it is usually hard to train discriminative semantic parsers via Maximum Likelihood Estimation (MLE) in an …...
Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing
AbstractSemantic parsing considers the task of mapping a natural language sentence into a target formal representation, where various sophisticated sequence-to-sequence (seq2seq) models have been applied with promising results. Generally, these …...
Unsupervised Open-domain Keyphrase Generation
AbstractIn this work, we study the problem of unsupervised open-domain keyphrase generation, where the objective is a keyphrase generation model that can be built without using human-labeled data and can …...