Abstract:Current autoencoder-based disentangled representation learning methods achieve disentanglement by penalizing the (aggregate) posterior to encourage statistical independence of the latent factors. This approach introduces a trade-off between disentangled representation learning and reconstruction quality since the model does not have enough capacity to learn correlated latent variables that capture detail information present in most image data. To overcome this trade-off, we present a novel multi-stage modeling approach where the disentangled factors are first learned using a penalty-based disentangled representation learning method; then, the low-quality reconstruction is improved with another deep generative model that is trained to model the missing correlated latent variables, adding detail information while maintaining conditioning on the previously learned disentangled factors. Taken together, our multi-stage modelling approach results in a single, coherent probabilistic model that is theoretically justified by the principal of D-separation and can be realized with a variety of model classes including likelihood-based models such as variational autoencoders, implicit models such as generative adversarial networks, and tractable models like normalizing flows or mixtures of Gaussians. We demonstrate that our multi-stage model has higher reconstruction quality than current state-of-the-art methods with equivalent disentanglement performance across multiple standard benchmarks. In addition, we apply the multi-stage model to generate synthetic tabular datasets, showcasing an enhanced performance over benchmark models across a variety of metrics. The interpretability analysis further indicates that the multi-stage model can effectively uncover distinct and meaningful features of variations from which the original distribution can be recovered.

Disentangled Representations via Synergy Minimization

Going Beyond Multi-Task Dense Prediction with Synergy Embedding Models

Disentangled Representations in Neural Models

Learning Disentangled Representation with Pairwise Independence

Towards efficient representation identification in supervised learning

Synergies between Disentanglement and Sparsity: Generalization and Identifiability in Multi-Task Learning

Disentangling Factors of Variation in Deep Representations Using Adversarial Training.

Deep Representation Debiasing Via Mutual Information Minimization and Maximization (student Abstract).

Independence Constrained Disentangled Representation Learning from Epistemological Perspective

Learning Disentangled Representations via Mutual Information Estimation

Symbolic Disentangled Representations for Images

Towards an Improved Metric for Evaluating Disentangled Representations

Correcting Flaws in Common Disentanglement Metrics

Disentanglement via Latent Quantization

Disentangled Representation Learning for Controllable Image Synthesis: an Information-Theoretic Perspective

Towards Better Understanding of Disentangled Representations via Mutual Information

Distributing Synergy Functions: Unifying Game-Theoretic Interaction Methods for Machine-Learning Explainability

Learning Disentangled Representations via Independent Subspaces

Improving the Reconstruction of Disentangled Representation Learners Via Multi-Stage Modelling.

Conformal Disentanglement: A Neural Framework for Perspective Synthesis and Differentiation

Transferring disentangled representations: bridging the gap between synthetic and real images