Abstract:Multiview learning has shown its superiority in visual classification compared with the single-view-based methods. Especially, due to the powerful representation capacity, the Gaussian process latent variable model (GPLVM)-based multiview approaches have achieved outstanding performances. However, most of them only follow the assumption that the shared latent variables can be generated from or projected to the multiple observations but fail to exploit the harmonization in the back constraint and adaptively learn a classifier according to these learned variables, which would result in performance degradation. To tackle these two issues, in this article, we propose a novel harmonization shared autoencoder GPLVM with a relaxed Hamming distance (HSAGP-RHD). Particularly, an autoencoder structure with the Gaussian process (GP) prior is first constructed to learn the shared latent variable for multiple views. To enforce the agreement among various views in the encoder, a harmonization constraint is embedded into the model by making consistency for the view-specific similarity. Furthermore, we also propose a novel discriminative prior, which is directly imposed on the latent variable to simultaneously learn the fused features and adaptive classifier in a unit model. In detail, the centroid matrix corresponding to the centroids of different categories is first obtained. A relaxed Hamming distance (RHD)-based measurement is subsequently presented to measure the similarity and dissimilarity between the latent variable and centroids, not only allowing us to get the closed-form solutions but also encouraging the points belonging to the same class to be close, while those belonging to different classes to be far. Due to this novel prior, the category of the out-of-sample is also allowed to be simply assigned in the testing phase. Experimental results conducted on three real-world data sets demonstrate the effectiveness of the proposed method compared with state-of-the-art approaches.

Latent Constraints on Unsupervised Text-Graph Alignment with Information Asymmetry.

UATST: Towards Unpaired Arbitrary Text-Guided Style Transfer with Cross-Space Modulation

Unsupervised Belief Representation Learning with Information-Theoretic Variational Graph Auto-Encoders

Unsupervised Adversarial Graph Alignment with Graph Embedding

Uniform Transformation: Refining Latent Representation in Variational Autoencoders

Asynchronous generative adversarial network for asymmetric unpaired image-to-image translation

Adaptive Latent Graph Representation Learning for Image-Text Matching

$α$-TCVAE: On the relationship between Disentanglement and Diversity

Latent-Glat: Glancing at Latent Variables for Parallel Text Generation

Shared Latent Space by Both Languages in Non-Autoregressive Neural Machine Translation

Unsupervised Graph-Text Mutual Conversion with a Unified Pretrained Language Model

Asymptotic Consistent Graph Structure Learning for Multivariate Time-Series Anomaly Detection

Modeling multiple latent information graph structures via graph convolutional network for aspect-based sentiment analysis

Learning Aligned Image-Text Representations Using Graph Attentive Relational Network

Joint Latent Dirichlet Allocation for Social Tags.

Harmonization Shared Autoencoder Gaussian Process Latent Variable Model with Relaxed Hamming Distance

Incomplete Graph Learning Via Attribute-Structure Decoupled Variational Auto-Encoder.

Discriminative Feature Alignment: Improving Transferability of Unsupervised Domain Adaptation by Gaussian-guided Latent Alignment

Information Theoretic Text-to-Image Alignment

Controllable Unsupervised Text Attribute Transfer via Editing Entangled Latent Representation

Weakly-supervised Knowledge Graph Alignment with Adversarial Learning