Abstract:Nonlinear dimensionality reduction (DR) algorithms can reveal the intrinsic characteristic of the high dimensional data in a succinct way. However, most of these methods suffer from two problems. First, the incremental dimensionality reduction problem, which means the algorithms cannot compute the embedding of new added data incrementally. Second, the high dimensional data reconstruction problem, which means the algorithms cannot recover the original high dimensional data from the embeddings. Both problems limit the application of the existing DR algorithms. In this paper, a dictionary-based algorithm for manifold learning is proposed to address the problems of incremental dimensionality reduction and high dimensional data reconstruction. In this algorithm, two dictionaries are trained. One is for the manifold in the high dimensional space and the other one is for the embeddings which can be computed by any existing DR method in the low dimensional space. When new data is added, dimensionality reduction and data reconstruction can just be conducted by coding this input data over one dictionary, and then use this code to recover the output data via the other dictionary. The proposed algorithm provides a general framework for manifold learning. It can be integrated into many existing DR algorithms to make them feasible to both incremental dimensionality reduction and high dimensional data reconstruction. The algorithm is efficient due to the closed-form solution for sparse coding and dictionary updating. Furthermore, the proposed algorithm is space-saving because it only needs to store two dictionaries instead of the whole training samples. Experiments conducted on synthetic datasets and real world datasets show that, no matter for incremental dimensionality reduction or high dimensional data reconstruction, the proposed algorithm is accurate and efficient.

Manifold-based Denoising, Outlier Detection, and Dimension Reduction Algorithm for High-Dimensional Data

Deep Manifold Transformation for Dimension Reduction

A Manifold-Based Dimension Reduction Algorithm Framework for Noisy Data Using Graph Sampling and Spectral Graph.

Dataset Denoising Based on Manifold Assumption

A Projective Noise Reduction Algorithm Based on Laplacian Smoothing

Design a Metric Robust to Complicated High Dimensional Noise for Efficient Manifold Denoising

Manifold Learning: Dimensionality Reduction and High Dimensional Data Reconstruction Via Dictionary Learning.

A point cloud denoising network based on manifold in an unknown noisy environment

A New Outlier Detection Algorithm Based on Manifold Learning

The research of detection of outliers based on manifold learning

Manifold Learning for Image Denoising

Comparison of Data Visualization, Outlier Detection and Data Dimensionality Reduction Methods

Dynamic Point Cloud Denoising via Manifold-to-Manifold Distance

Denoising for 3D Point Cloud Based on Regularization of a Statistical Low-Dimensional Manifold

A Fast Manifold Learning Algorithm for Dimensionality Reduction.

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Manifold Partition Discriminant Analysis

Differentiable Manifold Reconstruction for Point Cloud Denoising

Manifold-based learning and synthesis.

Noisy Manifold Learning Using Neighborhood Smoothing Embedding

Learning a Stable Local Manifold Representation for Hyperspectral Linear Dimensionality Reduction