Attention Matrix
metric
ID: attentionmatrix
Related Papers
Unsupervised Token-wise Alignment to Improve Interpretation of Encoder-Decoder Models
AbstractDeveloping a method for understanding the inner workings of black-box neural methods is an important research endeavor. Conventionally, many studies have used an attention matrix to interpret how Encoder-Decoder-based models …...
Effective Attention Sheds Light On Interpretability
An attention matrix of a transformer self- attention sublayer can provably be decom- posed into two components and only one of them (effective attention) contributes to the model output. This …...