Abstract:Dimension reduction (DR) aims to learn low-dimensional representations of high-dimensional data with the preservation of essential information. In the context of manifold learning, we define that the representation after information-lossless DR preserves the topological and geometric properties of data manifolds formally, and propose a novel two-stage DR method, called invertible manifold learning (inv-ML) to bridge the gap between theoretical information-lossless and practical DR. The first stage includes a homeomorphic sparse coordinate transformation to learn low-dimensional representations without destroying topology and a local isometry constraint to preserve local geometry. In the second stage, a linear compression is implemented for the trade-off between the target dimension and the incurred information loss in excessive DR scenarios. Experiments are conducted on seven datasets with a neural network implementation of inv-ML, called i-ML-Enc. Empirically, i-ML-Enc achieves invertible DR in comparison with typical existing methods as well as reveals the characteristics of the learned manifolds. Through latent space interpolation on real-world datasets, we find that the reliability of tangent space approximated by the local neighborhood is the key to the success of manifold-based DR algorithms.

Multi-Sample Incremental Manifold Learning Algorithm Based on Isogonal Mapping

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Learning an Image Manifold for Retrieval

Image Feature Optimization Based on Nonlinear Dimensionality Reduction

Image distance measurement based on manifold learning and manifold high-order approximation

Incremental Alignment Manifold Learning

Incremental Multi-manifold Out-of-Sample Data Prediction

Incremental and evolutionary manifold learning: a survey

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Incremental manifold learning via tangent space alignment

Dataset Denoising Based on Manifold Assumption

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Learning Manifold Structures With Subspace Segmentations

Invertible Manifold Learning for Dimension Reduction

A New Manifold Reconstruction Method Based on Isomap

IKLTSA: An Incremental Kernel LTSA Method

Adaptive Nonlinear Dimensionality Reduction with a Local Metric.

Learning discriminant isomap for dimensionality reduction

Nonparametric Discriminant Multi-Manifold Learning

Incremental Projection Vector Machine: A One-Stage Learning Algorithm for High-Dimension Large-Sample Dataset

Continuum Isomap for manifold learnings