Abstract:Dimensionality reduction plays a significant role in high-dimensional data processing, and Linear Discriminant Analysis (LDA) is a widely used supervised dimensionality reduction approach. However, a major drawback of LDA is that it is incapable of extracting the local structure information, which is crucial for handling multimodal data. In this article, we propose a novel supervised dimensionality reduction method named Adaptive Local Linear Discriminant Analysis (ALLDA), which adaptively learns a k -nearest neighbors graph from data themselves to extract the local connectivity of data. Furthermore, the original high-dimensional data usually contains noisy and redundant features, which has a negative impact on the evaluation of neighborships and degrades the subsequent classification performance. To address this issue, our method learns the similarity matrix and updates the subspace simultaneously so that the neighborships can be evaluated in the optimal subspaces where the noises have been removed. Through the optimal graph embedding, the underlying sub-manifolds of data in intra-class can be extracted precisely. Meanwhile, an efficient iterative optimization algorithm is proposed to solve the minimization problem. Promising experimental results on synthetic and real-world datasets are provided to evaluate the effectiveness of proposed method.

Semi-Supervised Nonparametric Discriminant Analysis

Semi-Supervised Discriminant Analysis Via Spectral Transduction.

Nonparametric Discriminant Multi-Manifold Learning

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Laplacian adaptive weighted discriminant analysis for semi-supervised multi-class classification

Geodesic Based Semi-supervised Multi-manifold Feature Extraction

Semi-supervised sub-manifold discriminant analysis

Spectral Clustering Based Null Space Linear Discriminant Analysis (Snlda)

Two-dimensional Nearest Neighbor Discriminant Analysis

Semi-supervised Discriminant Analysis Based on Sparse-Coding Theory

A New Graph Constructor for Semi-supervised Discriminant Analysis Via Group Sparsity.

Semi-supervised Discriminant Analysis Based on Dependence Estimation

An Improved DLDA Based Method- Nonparametric DLDA

Disambiguation Enabled Linear Discriminant Analysis for Partial Label Dimensionality Reduction

Adaptive Local Linear Discriminant Analysis

Classification by Semi-Supervised Discriminative Regularization

From NLDA to LDA/GSVD: a Modified NLDA Algorithm

Semi-supervised Hierarchical Clustering Analysis for High Dimensional Data

Nonnegative Discriminative Manifold Learning for Hyperspectral Data Dimension Reduction.

Dimension reduction-based adaptive-to-model semi-supervised classification

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning