Abstract:With the rapid advancements in data analysis and the increasing complexity of high-dimensional datasets, traditional dimensionality reduction techniques like Local Linear Embedding (LLE) often face challenges in maintaining accuracy and efficiency. This research aims to overcome the limitations of LLE, specifically its reliance on the nearest neighbor concept, its inability to distinguish differences among manifold points, and its underutilization of data discrimination information. To address these issues, we propose an advanced LLE algorithm that integrates decision tree-based neighbor recognition with Gaussian kernel density estimation. Decision trees accurately determine neighboring relationships, which are then optimized using Gaussian kernel density estimation to better reflect the distribution of sample points on the manifold. The algorithm also incorporates data discrimination information to enhance classification accuracy and efficiency. Evaluations in facial recognition tasks using SVM classifiers demonstrate significant improvements. Integrating decision trees (LLE-DT) yielded accuracy gains, with LFW at 98.75%, CFP 96.10%, and Olivetti 92.18%. Gaussian density estimation (LLE-GDE) achieved further enhancements, especially in LFW (99.13%), with CFP at 96.85%, and Olivetti at 91.82%. Combining both methods (LLE-DT-GDE) led to substantial improvements: LFW 99.61%, CFP 97.23%, and Olivetti 93.56%, highlighting the synergy between decision trees and Gaussian estimation. This advanced LLE algorithm effectively addresses the limitations of traditional approaches, showing promising results in complex data processing tasks such as facial recognition. These findings suggest its potential for broader applications in fields requiring robust data analysis and classification.

A class density approximation neural network for improving the generalization of Fisherface.

Improving the Generalization of Fisherface by Training Class Selection Using SOM2

Spectral analysis for face recognition

Face Recognition Based on Adaptively Weighted Fisherface

Hybrid of the Approximate Neural Network with Sparse Ram and Fisher'S Linear Discriminant for Face Recognition

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Membership-degree Preserving Discriminant Analysis with Applications to Face Recognition.

Hierarchical Ensemble of Gabor Fisher Classifier for Face Recognition

Patch-Based Gabor Fisher Classifier For Face

An efficient renovation on kernel Fisher discriminant analysis and face recognition experiments

Nearest-neighbor Classifier Motivated Marginal Discriminant Projections for Face Recognition

Deep Linear Discriminant Analysis on Fisher Networks: A Hybrid Architecture for Person Re-identification

Two-Dimensional fisher discriminant analysis and its application to face recognition

Integration of Manifold Learning and Density Estimation for Fine-Tuned Face Recognition

Asymboost-based Fisher Linear Classifier for Face Recognition

Learning prototype hyperplanes for face verification in the wild.

Improvement of face recognition performance using a new hybrid subspace classifier

Linear representation of intra‐class discriminant features for small‐sample face recognition

Making FLDA Applicable to Face Recognition with One Sample Per Person

Locality Preserving Fisher Discriminant Analysis for Face Recognition