Өзара ақпарат бағалаушылары
method
ID: mutualinformationestimators
Related Papers
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives
AbstractWe seek to understand how the representations of individual tokens and the structure of the learned feature space evolve between layers in deep neural networks under different learning objectives. We …...