Encoder Decoder Attention

method ID: encoderdecoderattention

Related Papers

Attend, Translate and Summarize: An Efficient Method for Neural Cross-Lingual Summarization

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractCross-lingual summarization aims at summarizing a document in one language (e.g., Chinese) into another language (e.g., English). In this paper, we propose a novel method inspired by the translation pattern …...

38216

Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThe copying mechanism has had considerable success in abstractive summarization, facilitating models to directly copy words from the input text to the output summary. Existing works mostly employ encoder-decoder attention, …...

31769

Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractTransformer models have achieved state-of-the-art results in a wide range of NLP tasks including summarization. Training and inference using large transformer models can be computationally expensive. Previous work has focused …...

30908