Abstract:With the rapid advancements in data analysis and the increasing complexity of high-dimensional datasets, traditional dimensionality reduction techniques like Local Linear Embedding (LLE) often face challenges in maintaining accuracy and efficiency. This research aims to overcome the limitations of LLE, specifically its reliance on the nearest neighbor concept, its inability to distinguish differences among manifold points, and its underutilization of data discrimination information. To address these issues, we propose an advanced LLE algorithm that integrates decision tree-based neighbor recognition with Gaussian kernel density estimation. Decision trees accurately determine neighboring relationships, which are then optimized using Gaussian kernel density estimation to better reflect the distribution of sample points on the manifold. The algorithm also incorporates data discrimination information to enhance classification accuracy and efficiency. Evaluations in facial recognition tasks using SVM classifiers demonstrate significant improvements. Integrating decision trees (LLE-DT) yielded accuracy gains, with LFW at 98.75%, CFP 96.10%, and Olivetti 92.18%. Gaussian density estimation (LLE-GDE) achieved further enhancements, especially in LFW (99.13%), with CFP at 96.85%, and Olivetti at 91.82%. Combining both methods (LLE-DT-GDE) led to substantial improvements: LFW 99.61%, CFP 97.23%, and Olivetti 93.56%, highlighting the synergy between decision trees and Gaussian estimation. This advanced LLE algorithm effectively addresses the limitations of traditional approaches, showing promising results in complex data processing tasks such as facial recognition. These findings suggest its potential for broader applications in fields requiring robust data analysis and classification.

Two-Dimensional Maximum Local Variation Based on Image Euclidean Distance for Face Recognition

Learning a Locality Preserving Subspace for Visual Recognition.

Image Feature Optimization Based on Nonlinear Dimensionality Reduction

Face Recognition Based on Non-local Similarity Dictionary.

Locality Pursuit Embedding

Image distance measurement based on manifold learning and manifold high-order approximation

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Nearest Manifold Approach for Face Recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Local Maximal Margin Discriminant Embedding for Face Recognition

Unified locally linear embedding and linear discriminant analysis algorithm (ULLELDA) for face recognition

Two Dimensional Discriminant Neighborhood Preserving Embedding in Face Recognition

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Discriminant Maximum Margin Projections for Face Recognition.

Manifold-manifold distance and its application to face recognition with image sets.

Learning High-Dimensional Correspondence Via Manifold Learning and Local Approximation

Local Graph Embedding Based on Maximum Margin Criterion Via Fuzzy Set

Multi-manifold Metric Learning for Face Recognition Based on Image Sets

Integration of Manifold Learning and Density Estimation for Fine-Tuned Face Recognition

Minimum-distance discriminant projection and its application to face recognition