Дивергенция Кульбака-Лейблера
Related Papers
Cross-Entropy and Linguistic Typology
The idea of '~familial relationships" among lan- guages is well-established and accepted, al- though some controversies persist in a few specific instances. By painstakingly record- ing and identifying regularities and …...
Measuring the compositionality of NV expressions in Basque by means of distributional similarity techniques
AbstractWe present several experiments aiming at measuring the semantic compositionality of NV expressions in Basque. Our approach is based on the hypothesis that compositionality can be related to distributional similarity. …...
Valence Shifting: Is It A Valid Task?
This paper looks at the problem of va- lence shifting, rewriting a text to preserve much of its meaning but alter its senti- ment characteristics. There has only been a …...
Experimenting with Power Divergences for Language Modeling
AbstractNeural language models are usually trained using Maximum-Likelihood Estimation (MLE). The corresponding objective function for MLE is derived from the Kullback-Leibler (KL) divergence between the empirical probability distribution representing the …...
APo-VAE: Text Generation in Hyperbolic Space
AbstractNatural language often exhibits inherent hierarchical structure ingrained with complex syntax and semantics. However, most state-of-the-art deep generative models learn embeddings only in Euclidean vector space, without accounting for this …...
Gaussian Process based Deep Dyna-Q approach for Dialogue Policy Learning
Applying reinforcement learning to dialogue policy learning requires prohibitively large rounds of human-machine interactions. To improve the learning performance, the Deep Dyna-Q framework with a world model that imitates real …...