Abstract:Dimensionality reduction plays a significant role in high-dimensional data processing, and Linear Discriminant Analysis (LDA) is a widely used supervised dimensionality reduction approach. However, a major drawback of LDA is that it is incapable of extracting the local structure information, which is crucial for handling multimodal data. In this article, we propose a novel supervised dimensionality reduction method named Adaptive Local Linear Discriminant Analysis (ALLDA), which adaptively learns a k -nearest neighbors graph from data themselves to extract the local connectivity of data. Furthermore, the original high-dimensional data usually contains noisy and redundant features, which has a negative impact on the evaluation of neighborships and degrades the subsequent classification performance. To address this issue, our method learns the similarity matrix and updates the subspace simultaneously so that the neighborships can be evaluated in the optimal subspaces where the noises have been removed. Through the optimal graph embedding, the underlying sub-manifolds of data in intra-class can be extracted precisely. Meanwhile, an efficient iterative optimization algorithm is proposed to solve the minimization problem. Promising experimental results on synthetic and real-world datasets are provided to evaluate the effectiveness of proposed method.

LLE dimensionality reduction based on kernel-induced distance measurement and its application in clustering with outliers

A Novel Kernel Possibitistic Fuzzy C-Means Clustering Algorithm For Large Scale Data Sets

Distance-Based Classifier Via the Kernel Trick.

Local Feature Discriminant Projection

Local Linear Embedding in Dimensionality Reduction Based on Small World Principle

An Iterative Locally Linear Embedding Algorithm

Improved LLE Algorithm and Its Application

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

A General Framework for Dimensionality Reduction of K-Means Clustering

Enhanced Locality Sensitive Clustering in High Dimensional Space

Local Regularized Least-Square Dimensionality Reduction

Adaptive Local Linear Discriminant Analysis

Local Linear Embedding with Adaptive Neighbors.

An Outlier Detection Method in High Dimensional Time Series Based on LLM

A Novel Fuzzy Kernel Clustering Algorithm for Outlier Detection

Cluster-Based Outlier Detection

Outlier detection algorithm based on k-nearest neighbors-local outlier factor

Unsupervised Discriminative Feature Selection in a Kernel Space Via L2, 1-Norm Minimization.

Approximate Orthogonal Sparse Embedding for Dimensionality Reduction

Fusion of Adaptive Local Linear Embedding and Spectral Clustering Algorithm with Application to Fault Diagnosis

Probability-Based Locally Linear Embedding for Classification