Abstract:We introduce a conditional generative model for learning to disentangle the hidden factors of variation within a set of labeled observations, and separate them into complementary codes. One code summarizes the specified factors of variation associated with the labels. The other summarizes the remaining unspecified variability. During training, the only available source of supervision comes from our ability to distinguish among different observations belonging to the same class. Examples of such observations include images of a set of labeled objects captured at different viewpoints, or recordings of set of speakers dictating multiple phrases. In both instances, the intra-class diversity is the source of the unspecified factors of variation: each object is observed at multiple viewpoints, and each speaker dictates multiple phrases. Learning to disentangle the specified factors from the unspecified ones becomes easier when strong supervision is possible. Suppose that during training, we have access to pairs of images, where each pair shows two different objects captured from the same viewpoint. This source of alignment allows us to solve our task using existing methods. However, labels for the unspecified factors are usually unavailable in realistic scenarios where data acquisition is not strictly controlled. We address the problem of disentaglement in this more general setting by combining deep convolutional autoencoders with a form of adversarial training. Both factors of variation are implicitly captured in the organization of the learned embedding space, and can be used for solving single-image analogies. Experimental results on synthetic and real datasets show that the proposed method is capable of generalizing to unseen classes and intra-class variabilities.

Combining deep generative and discriminative models for Bayesian semi-supervised learning

Generalized entropy based semi-supervised learning

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

A Hybrid Generative/discriminative Method for Semi-Supervised Classification

Multimodal deep generative adversarial models for scalable doubly semi-supervised learning

Generative-Discriminative Complementary Learning

Generative Modeling Helps Weak Supervision (and Vice Versa)

Disentangling Factors of Variation in Deep Representations Using Adversarial Training.

Semi-supervised Sequential Generative Models

A Hybrid of Generative and Discriminative Models Based on the Gaussian-coupled Softmax Layer

Semi-unsupervised Learning of Human Activity using Deep Generative Models

Discriminative multimodal learning via conditional priors in generative models

Semi-Supervised Multi-Label Learning from Crowds via Deep Sequential Generative Model

Learning Deep Generative Models with Doubly Stochastic Gradient MCMC

Learning Symbolic Representations Through Joint GEnerative and DIscriminative Training

Semi-Supervised Semantic Image Segmentation by Deep Diffusion Models and Generative Adversarial Networks

Learning Deep Generative Models with Doubly Stochastic MCMC

Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels

Semi-Supervised Few-Shot Classification with Deep Invertible Hybrid Models

Joint Semi-Supervised Feature Selection and Classification Through Bayesian Approach

Generate, Discriminate and Contrast: A Semi-Supervised Sentence Representation Learning Framework