Архитектура Seq2Seq
Related Papers
Evaluating Rewards for Question Generation Models
AbstractRecent approaches to question generation have used modifications to a Seq2Seq architecture inspired by advances in machine translation. Models are trained using teacher forcing to optimise only the one-step-ahead prediction. …...
BASS: Boosting Abstractive Summarization with Unified Semantic Graph
AbstractAbstractive summarization for long-document or multi-document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long-distance relations in text. In this paper, we present BASS, a …...
Solving SCAN Tasks with Data Augmentation and Input Embeddings
AbstractWe address the compositionality challenge presented by the SCAN benchmark. Using data augmentation and a modification of the standard seq2seq architecture with attention, we achieve SOTA results on all the …...
The impact of lexical and grammatical processing on generating code from natural language
AbstractConsidering the seq2seq architecture of Yin and Neubig (2018) for natural language to code translation, we identify four key components of importance: grammatical constraints, lexical preprocessing, input representations, and copy …...