Назар аудару басын маскалау

method ID: attentionheadmasking

Related Papers

Attention Head Masking for Inference Time Content Selection in Abstractive Summarization

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractHow can we effectively inform content selection in Transformer-based abstractive summarization models? In this work, we present a simple-yet-effective attention head masking technique, which is applied on encoder-decoder attentions to …...

21429