Механизм динамического вычисления важности головы
method
ID: dynamicheadimportancecomputationmechanism
Related Papers
A Dynamic Head Importance Computation Mechanism for Neural Machine Translation
AbstractMultiple parallel attention mechanisms that use multiple attention heads facilitate greater performance of the Transformer model for various applications e.g., Neural Machine Translation (NMT), text classification. In multi-head attention mechanism, …...