Abstract:Multiview learning has shown its superiority in visual classification compared with the single-view-based methods. Especially, due to the powerful representation capacity, the Gaussian process latent variable model (GPLVM)-based multiview approaches have achieved outstanding performances. However, most of them only follow the assumption that the shared latent variables can be generated from or projected to the multiple observations but fail to exploit the harmonization in the back constraint and adaptively learn a classifier according to these learned variables, which would result in performance degradation. To tackle these two issues, in this article, we propose a novel harmonization shared autoencoder GPLVM with a relaxed Hamming distance (HSAGP-RHD). Particularly, an autoencoder structure with the Gaussian process (GP) prior is first constructed to learn the shared latent variable for multiple views. To enforce the agreement among various views in the encoder, a harmonization constraint is embedded into the model by making consistency for the view-specific similarity. Furthermore, we also propose a novel discriminative prior, which is directly imposed on the latent variable to simultaneously learn the fused features and adaptive classifier in a unit model. In detail, the centroid matrix corresponding to the centroids of different categories is first obtained. A relaxed Hamming distance (RHD)-based measurement is subsequently presented to measure the similarity and dissimilarity between the latent variable and centroids, not only allowing us to get the closed-form solutions but also encouraging the points belonging to the same class to be close, while those belonging to different classes to be far. Due to this novel prior, the category of the out-of-sample is also allowed to be simply assigned in the testing phase. Experimental results conducted on three real-world data sets demonstrate the effectiveness of the proposed method compared with state-of-the-art approaches.

Semi-supervised Gaussian Process Latent Variable Model with Pairwise Constraints

Supervised Gaussian process latent variable model for dimensionality reduction.

Supervised Latent Linear Gaussian Process Latent Variable Model for Dimensionality Reduction

Dimensionality Detection and Integration of Multiple Data Sources via the GP-LVM

Mixed Likelihood Gaussian Process Latent Variable Model

Dimensionality Reduction with Latent Variable Model

Spike and Slab Gaussian Process Latent Variable Models

Latent variable Gaussian process models: A rank‐based analysis and an alternative approach

A Supervised Method For Nonlinear Dimensionality Reduction With Gplvm

Latent Map Gaussian Processes for Mixed Variable Metamodeling

Variational Inference for Uncertainty on the Inputs of Gaussian Process Models

Embedded Locality Discriminant GPLVM for Dimensionality Reduction.

Sparse Multimodal Gaussian Processes

A Latent Variable Approach to Gaussian Process Modeling with Qualitative and Quantitative Factors.

Harmonization Shared Autoencoder Gaussian Process Latent Variable Model with Relaxed Hamming Distance

Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

Laplacian pair-weight vector projection for semi-supervised learning

PG-LBO: Enhancing High-Dimensional Bayesian Optimization with Pseudo-Label and Gaussian Process Guidance

Latent mixed-effect models for high-dimensional longitudinal data

Fully Bayesian Inference for Latent Variable Gaussian Process Models

DGP-LVM: Derivative Gaussian process latent variable models