Abstract:Dimensionality reduction and incremental learning have recently received broad attention in many applications of data mining, pattern recognition, and information retrieval. Inspired by the concept of manifold learning, many discriminant embedding techniques have been introduced to seek low-dimensional discriminative manifold structure in the high-dimensional space for feature reduction and classification. However, such graph-embedding framework-based subspace methods usually confront two limitations: (1) since there is no available updating rule for local discriminant analysis with the additive data, it is difficult to design incremental learning algorithm and (2) the small sample size (SSS) problem usually occurs if the original data exist in very high-dimensional space. To overcome these problems, this paper devises a supervised learning method, called local discriminant subspace embedding (LDSE), to extract discriminative features. Then, the incremental-mode algorithm, incremental LDSE (ILDSE), is proposed to learn the local discriminant subspace with the newly inserted data, which applies incremental learning extension to the batch LDSE algorithm by employing the idea of singular value-decomposition (SVD) updating algorithm. Furthermore, the SSS problem is avoided in our method for the high-dimensional data and the benchmark incremental learning experiments on face recognition show that ILDSE bears much less computational cost compared with the batch algorithm.

Incremental Laplacian Eigenmaps by Preserving Adjacent Information Between Data Points

Laplacian Eigenmap for Image Retrieval

Image retrieval using dimensionality reduction

An Improved Laplacian Eigenmaps Algorithm for Nonlinear Dimensionality Reduction

A survey on Laplacian eigenmaps based manifold learning methods.

Incremental Manifold Learning by Spectral Embedding Methods

Relative Distance-Based Laplacian Eigenmaps

A New Manifold Learning Algorithm Based on Incremental Spectral Decomposition.

Incremental Manifold Learning Algorithm Using PCA on Overlapping Local Neighborhoods for Dimensionality Reduction

Incremental Alignment Manifold Learning

Multi-Sample Incremental Manifold Learning Algorithm Based on Isogonal Mapping

Locally Linear Embedding algorithm based on OMP for incremental learning

IKLTSA: An Incremental Kernel LTSA Method

Effective Dimensionality Reduction for Visualizing Neural Dynamics by Laplacian Eigenmaps

Kernel Based Incremental Learning Isomap Algorithm

A Linear Subspace Learning Algorithm For Incremental Data

Incremental manifold learning via tangent space alignment

Incremental Embedding and Learning in the Local Discriminant Subspace with Application to Face Recognition

An Incremental Manifold Learning Algorithm Based on Iterative Decomposition

Incremental Multi-manifold Out-of-Sample Data Prediction

Incremental LLE Based on Back Propagation Neural Network