Abstract:Dimensionality reduction plays a significant role in high-dimensional data processing, and Linear Discriminant Analysis (LDA) is a widely used supervised dimensionality reduction approach. However, a major drawback of LDA is that it is incapable of extracting the local structure information, which is crucial for handling multimodal data. In this article, we propose a novel supervised dimensionality reduction method named Adaptive Local Linear Discriminant Analysis (ALLDA), which adaptively learns a k -nearest neighbors graph from data themselves to extract the local connectivity of data. Furthermore, the original high-dimensional data usually contains noisy and redundant features, which has a negative impact on the evaluation of neighborships and degrades the subsequent classification performance. To address this issue, our method learns the similarity matrix and updates the subspace simultaneously so that the neighborships can be evaluated in the optimal subspaces where the noises have been removed. Through the optimal graph embedding, the underlying sub-manifolds of data in intra-class can be extracted precisely. Meanwhile, an efficient iterative optimization algorithm is proposed to solve the minimization problem. Promising experimental results on synthetic and real-world datasets are provided to evaluate the effectiveness of proposed method.

Fuzzy Constraints Linear Discriminant Analysis

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Discriminative analysis of direct linear discriminant analysis for face recognition

Constrained Linear Discrimination Analysis and Face Recognition

Locally Linear Factorization Machines.

Unsupervised Hyperspectral Image Classification Method Based on Constrained Linear Discriminant Analysis

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Face Recognition Using Novel LDA-Based Algorithms.

Neighborhood linear discriminant analysis

A Flexible and Efficient Algorithm for Regularized Fisher Discriminant Analysis.

Adaptive Linear Discriminant Regression Classification for Face Recognition

Local Fisher Discriminant Analysis with Locally Linear Embedding Affinity Matrix

F ‐norm two‐dimensional linear discriminant analysis and its application on face recognition

Adaptive Local Linear Discriminant Analysis

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

Minimally Informed Linear Discriminant Analysis: training an LDA model with unlabelled data

Latent Fisher Discriminant Analysis

Locality-regularized Linear Regression Discriminant Analysis for Feature Extraction

Discriminant Local Feature Analysis with Applications to Face Recognition

Approximately optimal domain adaptation with Fisher's Linear Discriminant