Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference
31267Related Entities
Attention Collapse
OtherEntity
Feature Diversity
Metric
Informative Representations
Metric
Multi-Head Attention
Method
Neural Attention Mechanism
Method
Particle Optimization
Method
Repulsive Attention
Method