Назар аудару басын маскалау
method
ID: attentionheadmasking
Related Papers
Attention Head Masking for Inference Time Content Selection in Abstractive Summarization
AbstractHow can we effectively inform content selection in Transformer-based abstractive summarization models? In this work, we present a simple-yet-effective attention head masking technique, which is applied on encoder-decoder attentions to …...