Abstract:Dimensionality reduction plays a key role in pattern recognition. It can preserve essential and inherent feature information while reducing noise and redundant information contained in the high-dimensional raw data, which achieve performance improvement in subsequent tasks (e.g., classification and clustering). Locality preserving projection (LPP), as a typical method for dimensionality reduction, can explore the local sub-manifold of the raw data with the aid of K-nearest neighbor (KNN). However, LPP has some serious limitations: (1) the neighbor parameter is artificially set, and this leads to the problem that the size of the neighbor parameter may affect the performance of LPP in the application; (2) LPP, as a single-view method, cannot function in multi-view data; (3) LPP ignores both the discriminative information and the global linear relationship of the raw data. In response to these limitations, we propose a novel multi-view dimensionality reduction method called coupled locality discriminant analysis with globality preserving (CLDA-GP). CLDA-GP can learn a couple of optimal mappings so that different multi-view raw spaces can be mapped into a low-dimensional uniform elastic subspace while keeping the local sub-manifold and global linear relationship. It is also worth mentioning that CLDA-GP gives another strategy called local similarity self-learning (LSSL) to excavate the local manifold information of the multi-view data. By utilizing the LSSL strategy, CLDA-GP casts off the limitation of the neighbor parameter. Besides, CLDA-GP further introduces the supervision information of the raw data, which enables its discriminant power. The experiment results on the artificial and benchmark (COIL-20, GT, and Umist) datasets prove CLDA-GP outperforms the comparative methods, which also illustrate the effectiveness and feasibility of CLDA-GP.

Embedded Locality Discriminant GPLVM for Dimensionality Reduction.

Locality Pursuit Embedding

Learning a Locality Preserving Subspace for Visual Recognition.

Supervised Gaussian process latent variable model for dimensionality reduction.

Coupled locality discriminant analysis with globality preserving for dimensionality reduction

A Bayesian Gaussian Process-Based Latent Discriminative Generative Decoder (LDGD) Model for High-Dimensional Data

Local Feature Discriminant Projection

Dimensionality Detection and Integration of Multiple Data Sources via the GP-LVM

Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling

Semi-supervised Gaussian Process Latent Variable Model with Pairwise Constraints

Hyperboloid GPLVM for Discovering Continuous Hierarchies via Nonparametric Estimation

Gaussian Process Latent Random Field.

Grassmannian Discriminant Maps (GDM) for Manifold Dimensionality Reduction with Application to Image Set Classification

Locality-regularized Linear Regression Discriminant Analysis for Feature Extraction

Locality-based Linear Discriminant Projection

Spike and Slab Gaussian Process Latent Variable Models

Mixed Likelihood Gaussian Process Latent Variable Model

DGP-LVM: Derivative Gaussian process latent variable models

Image Clustering Using Local Discriminant Models and Global Integration

Deep Latent Dirichlet Allocation with Topic-Layer-Adaptive Stochastic Gradient Riemannian MCMC