Encoder Decoder Attention
method
ID: encoderdecoderattention
Related Papers
Attend, Translate and Summarize: An Efficient Method for Neural Cross-Lingual Summarization
AbstractCross-lingual summarization aims at summarizing a document in one language (e.g., Chinese) into another language (e.g., English). In this paper, we propose a novel method inspired by the translation pattern …...
Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization
AbstractThe copying mechanism has had considerable success in abstractive summarization, facilitating models to directly copy words from the input text to the output summary. Existing works mostly employ encoder-decoder attention, …...
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems
AbstractTransformer models have achieved state-of-the-art results in a wide range of NLP tasks including summarization. Training and inference using large transformer models can be computationally expensive. Previous work has focused …...