Neural Attention Models
Related Papers
Addressing the Data Sparsity Issue in Neural AMR Parsing
AbstractNeural attention models have achieved great success in different NLP tasks. However, they have not fulfilled their promise on the AMR parsing task due to the data sparsity issue. In …...
Classical Structured Prediction Losses for Sequence to Sequence Learning
AbstractThere has been much recent work on training neural attention models at the sequence-level using either reinforcement learning-style methods or by optimizing the beam. In this paper, we survey a …...
The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants
AbstractReasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are …...
Leveraging Locality in Abstractive Text Summarization
AbstractNeural attention models have achieved significant improvements on many natural language processing tasks. However, the quadratic memory complexity of the self-attention module with respect to the input length hinders their …...