Self Attention Network
Related Papers
Importance of Self-Attention for Sentiment Analysis
AbstractDespite their superior performance, deep learning models often lack interpretability. In this paper, we explore the modeling of insightful relations between words, in order to understand and enhance predictions. To …...
Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention
AbstractSemantically controlled neural response generation on limited-domain has achieved great performance. However, moving towards multi-domain large-scale scenarios are shown to be difficult because the possible combinations of semantic inputs grow …...
Shrinking Japanese Morphological Analyzers With Neural Networks and Semi-supervised Learning
AbstractFor languages without natural word boundaries, like Japanese and Chinese, word segmentation is a prerequisite for downstream analysis. For Japanese, segmentation is often done jointly with part of speech tagging, …...
Yimmon at SemEval-2019 Task 9: Suggestion Mining with Hybrid Augmented Approaches
AbstractSuggestion mining task aims to extract tips, advice, and recommendations from unstructured text. The task includes many challenges, such as class imbalance, figurative expressions, context dependency, and long and complex …...
Multi-Head Highly Parallelized LSTM Decoder for Neural Machine Translation
AbstractOne of the reasons Transformer translation models are popular is that self-attention networks for context modelling can be easily parallelized at sequence level. However, the computational complexity of a self-attention …...
Relying on Discourse Analysis to Answer Complex Questions by Neural Machine Reading Comprehension
AbstractMachine reading comprehension (MRC) is one of the most challenging tasks in natural language processing domain. Recent state-of-the-art results for MRC have been achieved with the pre-trained language models, such …...