Abstract:Multiview learning has shown its superiority in visual classification compared with the single-view-based methods. Especially, due to the powerful representation capacity, the Gaussian process latent variable model (GPLVM)-based multiview approaches have achieved outstanding performances. However, most of them only follow the assumption that the shared latent variables can be generated from or projected to the multiple observations but fail to exploit the harmonization in the back constraint and adaptively learn a classifier according to these learned variables, which would result in performance degradation. To tackle these two issues, in this article, we propose a novel harmonization shared autoencoder GPLVM with a relaxed Hamming distance (HSAGP-RHD). Particularly, an autoencoder structure with the Gaussian process (GP) prior is first constructed to learn the shared latent variable for multiple views. To enforce the agreement among various views in the encoder, a harmonization constraint is embedded into the model by making consistency for the view-specific similarity. Furthermore, we also propose a novel discriminative prior, which is directly imposed on the latent variable to simultaneously learn the fused features and adaptive classifier in a unit model. In detail, the centroid matrix corresponding to the centroids of different categories is first obtained. A relaxed Hamming distance (RHD)-based measurement is subsequently presented to measure the similarity and dissimilarity between the latent variable and centroids, not only allowing us to get the closed-form solutions but also encouraging the points belonging to the same class to be close, while those belonging to different classes to be far. Due to this novel prior, the category of the out-of-sample is also allowed to be simply assigned in the testing phase. Experimental results conducted on three real-world data sets demonstrate the effectiveness of the proposed method compared with state-of-the-art approaches.

Multi-view Gaussian Processes with Posterior Consistency.

Multiview Learning with Variational Mixtures of Gaussian Processes

Multiview Variational Sparse Gaussian Processes.

Asymmetric Gaussian Process Multi-View Learning for Visual Classification.

Multi-View Representation Learning with Deep Gaussian Processes

Sparse Multimodal Gaussian Processes

Multi-View Deep Gaussian Processes for Supervised Learning

Multi-view Deep Gaussian Process with a Pre-training Acceleration Technique

Multi-view Collaborative Gaussian Process Dynamical Systems

Large-margin multi-view Gaussian process

Harmonization Shared Autoencoder Gaussian Process Latent Variable Model with Relaxed Hamming Distance

Multi-view Restricted Boltzmann Machines with Posterior Consistency

Large-margin multi-view Gaussian process for image classification

Variational Mixtures of Gaussian Processes for Classification.

Multiview Learning with Generalized Eigenvalue Proximal Support Vector Machines

Multi-View Support Vector Machines with the Consensus and Complementarity Information

Memory-Based Dual Gaussian Processes for Sequential Learning

Variable Sigma Gaussian Processes: an Expectation Propagation Perspective

Multiview Supervised Learning

Multi-task Sparse Gaussian Processes with Improved Multi-task Sparsity Regularization.

Multi-view Learning Via Multiple Graph Regularized Generative Model