Нейрондық назар механизмі
Related Papers
Deep Joint Entity Disambiguation with Local Neural Attention
AbstractWe propose a novel deep learning model for joint document-level entity disambiguation, which leverages learned neural representations. Key components are entity embeddings, a neural attention mechanism over local context windows, …...
Learning to Detect Opinion Snippet for Aspect-Based Sentiment Analysis
AbstractAspect-based sentiment analysis (ABSA) is to predict the sentiment polarity towards a particular aspect in a sentence. Recently, this task has been widely addressed by the neural attention mechanism, which …...
Neural Attentive Bag-of-Entities Model for Text Classification
AbstractThis study proposes a Neural Attentive Bag-of-Entities model, which is a neural network model that performs text classification using entities in a knowledge base. Entities provide unambiguous and relevant semantic …...
Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference
AbstractThe neural attention mechanism plays an important role in many natural language processing applications. In particular, multi-head attention extends single-head attention by allowing a model to jointly attend information from …...