Abstract:MOTIVATION:While generative models have shown great success in sampling high-dimensional samples conditional on low-dimensional descriptors (stroke thickness in MNIST, hair color in CelebA, speaker identity in WaveNet), their generation out-of-distribution poses fundamental problems due to the difficulty of learning compact joint distribution across conditions. The canonical example of the conditional variational autoencoder (CVAE), for instance, does not explicitly relate conditions during training and, hence, has no explicit incentive of learning such a compact representation.RESULTS:We overcome the limitation of the CVAE by matching distributions across conditions using maximum mean discrepancy in the decoder layer that follows the bottleneck. This introduces a strong regularization both for reconstructing samples within the same condition and for transforming samples across conditions, resulting in much improved generalization. As this amount to solving a style-transfer problem, we refer to the model as transfer VAE (trVAE). Benchmarking trVAE on high-dimensional image and single-cell RNA-seq, we demonstrate higher robustness and higher accuracy than existing approaches. We also show qualitatively improved predictions by tackling previously problematic minority classes and multiple conditions in the context of cellular perturbation response to treatment and disease based on high-dimensional single-cell gene expression data. For generic tasks, we improve Pearson correlations of high-dimensional estimated means and variances with their ground truths from 0.89 to 0.97 and 0.75 to 0.87, respectively. We further demonstrate that trVAE learns cell-type-specific responses after perturbation and improves the prediction of most cell-type-specific genes by 65%.AVAILABILITY AND IMPLEMENTATION:The trVAE implementation is available via github.com/theislab/trvae. The results of this article can be reproduced via github.com/theislab/trvae_reproducibility.

Condition-Transforming Variational Autoencoder for Generating Diverse Short Text Conversations.

Condition-Transforming Variational Autoencoder for Generating Diverse Short Text Conversations

Condition-transforming Variational Autoencoder for Conversation Response Generation.

Improve Diverse Text Generation by Self Labeling Conditional Variational Auto Encoder

Boosting Variational Generative Model Via Condition Enhancing and Lexical-Editing

Statistics Enhancement Generative Adversarial Networks for Diverse Conditional Image Synthesis

Conditional out-of-sample generation for unpaired data using trVAE

Advanced Conditional Variational Autoencoders (A-CVAE): Towards interpreting open-domain conversation generation via disentangling latent feature representation

Transformer-Based Conditioned Variational Autoencoder for Dialogue Generation

Conditional Out-of-distribution Generation for Unpaired Data Using Transfer VAE.

Plan-CVAE - A Planning-Based Conditional Variational Autoencoder for Story Generation.

Improving the Responses Diversity of Persona-based Neural Conversation System: A Conditional Variational Autoencoders-based Approach

Emotion-Regularized Conditional Variational Autoencoder for Emotional Response Generation

Pre-train and Plug-in: Flexible Conditional Text Generation with Variational Auto-Encoders

Topic Enhanced Controllable CVAE for Dialogue Generation (student Abstract).

Cross-Utterance Conditioned VAE for Non-Autoregressive Text-to-Speech

Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space

Cross-Utterance Conditioned VAE for Speech Generation

Diverse Image Captioning via Conditional Variational Autoencoder and Dual Contrastive Learning

Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders

DialogWAE: Multimodal Response Generation with Conditional Wasserstein Auto-Encoder