Abstract:Dimensionality reduction plays a key role in pattern recognition. It can preserve essential and inherent feature information while reducing noise and redundant information contained in the high-dimensional raw data, which achieve performance improvement in subsequent tasks (e.g., classification and clustering). Locality preserving projection (LPP), as a typical method for dimensionality reduction, can explore the local sub-manifold of the raw data with the aid of K-nearest neighbor (KNN). However, LPP has some serious limitations: (1) the neighbor parameter is artificially set, and this leads to the problem that the size of the neighbor parameter may affect the performance of LPP in the application; (2) LPP, as a single-view method, cannot function in multi-view data; (3) LPP ignores both the discriminative information and the global linear relationship of the raw data. In response to these limitations, we propose a novel multi-view dimensionality reduction method called coupled locality discriminant analysis with globality preserving (CLDA-GP). CLDA-GP can learn a couple of optimal mappings so that different multi-view raw spaces can be mapped into a low-dimensional uniform elastic subspace while keeping the local sub-manifold and global linear relationship. It is also worth mentioning that CLDA-GP gives another strategy called local similarity self-learning (LSSL) to excavate the local manifold information of the multi-view data. By utilizing the LSSL strategy, CLDA-GP casts off the limitation of the neighbor parameter. Besides, CLDA-GP further introduces the supervision information of the raw data, which enables its discriminant power. The experiment results on the artificial and benchmark (COIL-20, GT, and Umist) datasets prove CLDA-GP outperforms the comparative methods, which also illustrate the effectiveness and feasibility of CLDA-GP.

Supervised Gaussian process latent variable model for dimensionality reduction.

Semi-supervised Gaussian Process Latent Variable Model with Pairwise Constraints

Dimensionality Detection and Integration of Multiple Data Sources via the GP-LVM

Mixed Likelihood Gaussian Process Latent Variable Model

Embedded Locality Discriminant GPLVM for Dimensionality Reduction.

Spike and Slab Gaussian Process Latent Variable Models

Variational Inference for Uncertainty on the Inputs of Gaussian Process Models

A Bayesian Gaussian Process-Based Latent Discriminative Generative Decoder (LDGD) Model for High-Dimensional Data

Coupled locality discriminant analysis with globality preserving for dimensionality reduction

Latent variable Gaussian process models: A rank‐based analysis and an alternative approach

Process Data Analytics Via Probabilistic Latent Variable Models: A Tutorial Review

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Large Linear Multi-output Gaussian Process Learning

Generative Classification Model for Categorical Data Based on Latent Gaussian Process.

Unsupervised learning with contrastive latent variable models

DGP-LVM: Derivative Gaussian process latent variable models

Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling

Latent Map Gaussian Processes for Mixed Variable Metamodeling

Learning Latent Variable Gaussian Graphical Models

Divergence Maximizing Linear Projection for Supervised Dimension Reduction