Normalizing Flows
Related Papers
On the Sentence Embeddings from Pre-trained Language Models
AbstractPre-trained contextual representations like BERT have achieved great success in natural language processing. However, the sentence embeddings from the pre-trained language models without fine-tuning have been found to poorly capture …...
Variational Neural Machine Translation with Normalizing Flows
AbstractVariational Neural Machine Translation (VNMT) is an attractive framework for modeling the generation of target translations, conditioned not only on the source sentence but also on some latent random variables. …...
FlowPrior: Learning Expressive Priors for Latent Variable Sentence Models
AbstractVariational autoencoders (VAEs) are widely used for latent variable modeling of text. We focus on variations that learn expressive prior distributions over the latent variable. We find that existing training …...
Flow-Adapter Architecture for Unsupervised Machine Translation
AbstractIn this work, we propose a flow-adapter architecture for unsupervised NMT. It leverages normalizing flows to explicitly model the distributions of sentence-level latent representations, which are subsequently used in conjunction …...