Conditional Entropy
method
ID: conditionalentropy
Related Papers
Unsupervised Model Adaptation using Information-Theoretic Criterion
In this paper we propose a novel general framework for unsupervised model adapta- tion. Our method is based on entropy which has been used previously as a regularizer in semi-supervised …...
On the Complexity and Typology of Inflectional Morphological Systems
AbstractWe quantify the linguistic complexity of different languages’ morphological systems. We verify that there is a statistically significant empirical trade-off between paradigm size and irregularity: A language’s inflectional paradigms may …...
Efficient Transformers with Dynamic Token Pooling
AbstractTransformers achieve unrivalled performance in modelling language, but remain inefficient in terms of memory and time complexity. A possible remedy is to reduce the sequence length in the intermediate layers …...