Вариационный информационный узел внимания

Though being a primary trend for enhancing interpretability of neural networks, attention mechanism’s reliability and validity are still under debate. In this paper, we try to pu- rify attention scores …...