Abstract:Dimensionality reduction and incremental learning have recently received broad attention in many applications of data mining, pattern recognition, and information retrieval. Inspired by the concept of manifold learning, many discriminant embedding techniques have been introduced to seek low-dimensional discriminative manifold structure in the high-dimensional space for feature reduction and classification. However, such graph-embedding framework-based subspace methods usually confront two limitations: (1) since there is no available updating rule for local discriminant analysis with the additive data, it is difficult to design incremental learning algorithm and (2) the small sample size (SSS) problem usually occurs if the original data exist in very high-dimensional space. To overcome these problems, this paper devises a supervised learning method, called local discriminant subspace embedding (LDSE), to extract discriminative features. Then, the incremental-mode algorithm, incremental LDSE (ILDSE), is proposed to learn the local discriminant subspace with the newly inserted data, which applies incremental learning extension to the batch LDSE algorithm by employing the idea of singular value-decomposition (SVD) updating algorithm. Furthermore, the SSS problem is avoided in our method for the high-dimensional data and the benchmark incremental learning experiments on face recognition show that ILDSE bears much less computational cost compared with the batch algorithm.

Locally Linear Embedding algorithm based on OMP for incremental learning

Locality Pursuit Embedding

An Iterative Locally Linear Embedding Algorithm

Supervised Locally Linear Embedding Algorithm Based on Orthogonal Matching Pursuit.

Orthogonal Centroid Locally Linear Embedding For Classification

Locally Linear Embedding Preserving Local Neighborhood

Local Linear Embedding with Adaptive Neighbors.

A modified local linear embedding algorithm based on neighbour selection.

Local Linear Transformation Embedding

Incremental LLE Based on Back Propagation Neural Network

Approximate Orthogonal Sparse Embedding for Dimensionality Reduction

AN IMPROVED ALGORITHM ON LOCALLY LINEAR EMBEDDING

Incremental Laplacian Eigenmaps by Preserving Adjacent Information Between Data Points

Flexible Orthogonal Neighborhood Preserving Embedding.

Self-organized locally linear embedding for nonlinear dimensionality reduction

NNNPE: non-neighbourhood and neighbourhood preserving embedding

Clustering-Based Locally Linear Embedding

Locally Linear Embedding Based on Neiderreit Sequence Initialized Pelican Optimization Algorithm

Robust Integrated Locally Linear Embedding

Incremental Embedding and Learning in the Local Discriminant Subspace with Application to Face Recognition

Nonlinear embedding preserving multiple local-linearities