Иерархическое внимание
Related Papers
Data-to-text Generation with Entity Modeling
AbstractRecent approaches to data-to-text generation have shown great promise thanks to the use of large-scale datasets and the application of neural network architectures which are trained end-to-end. These models rely …...
Selective Attention for Context-aware Neural Machine Translation
AbstractDespite the progress made in sentence-level NMT, current systems still fall short at achieving fluent, good quality translation for a full document. Recent works in context-aware NMT consider only a …...
Dual Attention Network for Cross-lingual Entity Alignment
AbstractCross-lingual Entity alignment is an essential part of building a knowledge graph, which can help integrate knowledge among different language knowledge graphs. In the real KGs, there exists an imbalance …...
IITP-AINLPML at SemEval-2020 Task 12: Offensive Tweet Identification and Target Categorization in a Multitask Environment
AbstractIn this paper, we describe the participation of IITP-AINLPML team in the SemEval-2020 SharedTask 12 on Offensive Language Identification and Target Categorization in English Twitter data. Our proposed model learns …...
Multi-view Story Characterization from Movie Plot Synopses and Reviews
AbstractThis paper considers the problem of characterizing stories by inferring properties such as theme and style using written synopses and reviews of movies. We experiment with a multi-label dataset of …...
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences
AbstractWe describe an efficient hierarchical method to compute attention in the Transformer architecture. The proposed attention mechanism exploits a matrix structure similar to the Hierarchical Matrix (H-Matrix) developed by the …...
Heterogeneous Graph Neural Networks for Keyphrase Generation
AbstractThe encoder–decoder framework achieves state-of-the-art results in keyphrase generation (KG) tasks by predicting both present keyphrases that appear in the source document and absent keyphrases that do not. However, relying …...