Эффективное внимание
otherentity
ID: effectiveattention
Related Papers
Effective Attention Sheds Light On Interpretability
An attention matrix of a transformer self- attention sublayer can provably be decom- posed into two components and only one of them (effective attention) contributes to the model output. This …...