Abstract:Dimensionality reduction is a crucial step for pattern recognition and data mining tasks to overcome the curse of dimensionality. Principal component analysis (PCA) is a traditional technique for unsupervised dimensionality reduction, which is often employed to seek a projection to best represent the data in a least-squares sense, but if the original data is nonlinear structure, the performance of PCA will quickly drop. An supervised dimensionality reduction algorithm called Linear discriminant analysis (LDA) seeks for an embedding transformation, which can work well with Gaussian distribution data or single-modal data, but for non-Gaussian distribution data or multimodal data, it gives undesired results. What is worse, the dimension of LDA cannot be more than the number of classes. In order to solve these issues, Local shrunk discriminant analysis (LSDA) is proposed in this work to process the non-Gaussian distribution data or multimodal data, which not only incorporate both the linear and nonlinear structures of original data, but also learn the pattern shrinking to make the data more flexible to fit the manifold structure. Further, LSDA has more strong generalization performance, whose objective function will become local LDA and traditional LDA when different extreme parameters are utilized respectively. What is more, a new efficient optimization algorithm is introduced to solve the non-convex objective function with low computational cost. Compared with other related approaches, such as PCA, LDA and local LDA, the proposed method can derive a subspace which is more suitable for non-Gaussian distribution and real data. Promising experimental results on different kinds of data sets demonstrate the effectiveness of the proposed approach.

Structured Sparse Linear Discriminant Analysis

Towards Robust and Sparse Linear Discriminant Analysis for Image Classification

Understanding and Evaluating Sparse Linear Discriminant Analysis

Sparse L1-norm-based linear discriminant analysis

Structured Semi-Supervised Discriminant Analysis

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

Multimodal Linear Discriminant Analysis Via Structural Sparsity

Generalized robust linear discriminant analysis for jointly sparse learning

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Optimal Feature Selection for Sparse Linear Discriminant Analysis and Its Applications in Gene Expression Data

Constrained Linear Discrimination Analysis and Face Recognition

A linear subspace learning approach via sparse coding

Sparsity Induced Locality Preserving Projection Approaches for Dimensionality Reduction

Sparse Regularization Discriminant Analysis for Face Recognition

Semi-supervised Linear Discriminant Analysis for Dimension Reduction and Classification

Regularized Deep Linear Discriminant Analysis

Local Shrunk Discriminant Analysis (LSDA).

Linear discriminant analysis with spectral regularization

Latent Linear Discriminant Analysis for feature extraction via Isometric Structural Learning

Tensor Linear Discriminant Analysis

Sparse tensor discriminant analysis