Abstract:Dimensionality reduction plays a key role in pattern recognition. It can preserve essential and inherent feature information while reducing noise and redundant information contained in the high-dimensional raw data, which achieve performance improvement in subsequent tasks (e.g., classification and clustering). Locality preserving projection (LPP), as a typical method for dimensionality reduction, can explore the local sub-manifold of the raw data with the aid of K-nearest neighbor (KNN). However, LPP has some serious limitations: (1) the neighbor parameter is artificially set, and this leads to the problem that the size of the neighbor parameter may affect the performance of LPP in the application; (2) LPP, as a single-view method, cannot function in multi-view data; (3) LPP ignores both the discriminative information and the global linear relationship of the raw data. In response to these limitations, we propose a novel multi-view dimensionality reduction method called coupled locality discriminant analysis with globality preserving (CLDA-GP). CLDA-GP can learn a couple of optimal mappings so that different multi-view raw spaces can be mapped into a low-dimensional uniform elastic subspace while keeping the local sub-manifold and global linear relationship. It is also worth mentioning that CLDA-GP gives another strategy called local similarity self-learning (LSSL) to excavate the local manifold information of the multi-view data. By utilizing the LSSL strategy, CLDA-GP casts off the limitation of the neighbor parameter. Besides, CLDA-GP further introduces the supervision information of the raw data, which enables its discriminant power. The experiment results on the artificial and benchmark (COIL-20, GT, and Umist) datasets prove CLDA-GP outperforms the comparative methods, which also illustrate the effectiveness and feasibility of CLDA-GP.

Hierarchical clustered multiclass discriminant analysis via cross-validation

Cross-validation in high-dimensional spaces: a lifeline for least-squares models and multi-class LDA

Data-adaptive binary classifiers in high dimensions using random partitioning

Subspace Clustering by Directly Solving Discriminative K-means

Reverse nearest neighbors Bhattacharyya bound linear discriminant analysis for multimodal classification

Global subclass discriminant analysis

Cross-Validation Approach to Evaluate Clustering Algorithms: An Experimental Study Using Multi-Label Datasets

Kernel-based Hierarchical Discriminant Regression

Multimodal Linear Discriminant Analysis Via Structural Sparsity

Regularized Deep Linear Discriminant Analysis

Adaptive Local Linear Discriminant Analysis

Coupled locality discriminant analysis with globality preserving for dimensionality reduction

Deep Clustering: On the Link Between Discriminative Models and K-Means

Class-Distributed Learning for Multinomial Logistic Regression with High Dimensional Features and a Large Number of Classes

Sparse linear discriminant analysis by thresholding for high dimensional data

A New Reduced-Rank Linear Discriminant Analysis Method and Its Applications

Improve Heteroscedastic Discriminant Analysis by Using CBP Algorithm.

Network linear discriminant analysis

Laplacian adaptive weighted discriminant analysis for semi-supervised multi-class classification

Multiclass Spectral Clustering Based on Discriminant Analysis

Discriminant analysis via support vectors