Posterior Collapse
otherentity
ID: posteriorcollapse
Related Papers
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
AbstractVariational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation with latent variables. However, previous works typically focus on synthesizing relatively short sentences (up to …...
A Batch Normalized Inference Network Keeps the KL Vanishing Away
AbstractVariational Autoencoder (VAE) is widely used as a generative model to approximate a model’s posterior on latent variables by combining the amortized variational inference and deep neural networks. However, when …...
On the Encoder-Decoder Incompatibility in Variational Text Modeling and Beyond
AbstractVariational autoencoders (VAEs) combine latent variables with amortized variational inference, whose optimization usually converges into a trivial local optimum termed posterior collapse, especially in text modeling. By tracking the optimization …...