Abstract:Approximating distributions over complicated manifolds, such as natural images, are conceptually attractive. The deep latent variable model, trained using variational autoencoders and generative adversarial networks, is now a key technique for representation learning. However, it is difficult to unify these two models for exact latent-variable inference and parallelize both reconstruction and sampling, partly due to the regularization under the latent variables, to match a simple explicit prior distribution. These approaches are prone to be oversimplified, and can only characterize a few modes of the true distribution. Based on the recently proposed Wasserstein autoencoder (WAE) with a new regularization as an optimal transport. The paper proposes a stacked Wasserstein autoencoder (SWAE) to learn a deep latent variable model. SWAE is a hierarchical model, which relaxes the optimal transport constraints at two stages. At the first stage, the SWAE flexibly learns a representation distribution, i.e., the encoded prior; and at the second stage, the encoded representation distribution is approximated with a latent variable model under the regularization encouraging the latent distribution to match the explicit prior. This model allows us to generate natural textual outputs as well as perform manipulations in the latent space to induce changes in the output space. Both quantitative and qualitative results demonstrate the superior performance of SWAE compared with the state-of-the-art approaches in terms of faithful reconstruction and generation quality.

Modeling Personalization in Continuous Space for Response Generation Via Augmented Wasserstein Autoencoders

DialogWAE: Multimodal Response Generation with Conditional Wasserstein Auto-Encoder

Guiding Variational Response Generator to Exploit Persona

Multimodal Latent Language Modeling with Next-Token Diffusion

Towards Multimodal Response Generation with Exemplar Augmentation and Curriculum Optimization

DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation

Improving the Responses Diversity of Persona-based Neural Conversation System: A Conditional Variational Autoencoders-based Approach

Probabilistic Natural Language Generation with Wasserstein Autoencoders.

Neural Response Generation with Dynamic Vocabularies

Multimodal Weibull Variational Autoencoder for Jointly Modeling Image-Text Data

Multimodal hierarchical Variational AutoEncoders with Factor Analysis latent space

RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language Modeling

Learning to improve persona consistency in conversation generation with information augmentation

Condition-transforming Variational Autoencoder for Conversation Response Generation.

Stacked Wasserstein Autoencoder

A Latent-Constrained Variational Neural Dialogue Model for Information-Rich Responses

Advanced Conditional Variational Autoencoders (A-CVAE): Towards interpreting open-domain conversation generation via disentangling latent feature representation

Topic Modeling with Wasserstein Autoencoders

DLVGen: A Dual Latent Variable Approach to Personalized Dialogue Generation

Emotion-Regularized Conditional Variational Autoencoder for Emotional Response Generation

Neural personalized response generation as domain adaptation