Abstract:Recent decades have witnessed a much increased demand for advanced, effective and efficient methods and tools for analyzing, understanding and dealing with data of increasingly complex, high dimensionality and large volume. Whether it is in biology, neuroscience, modern medicine and social sciences or in engineering and computer vision, data are being sampled, collected and cumulated in an unprecedented speed. It is no longer a trivial task to analyze huge amounts of high dimensional data. A systematic, automated way of interpreting data and representing them has become a great challenge facing almost all fields and research in this emerging area has flourished. Several lines of research have embarked on this timely challenge and tremendous progresses and advances have been made recently. Traditional and linear methods are being extended or enhanced in order to meet the new challenges. This paper elaborates on these recent advances and discusses various state-of-the-art algorithms proposed from statistics, geometry and adaptive neural networks. The developments mainly follow three lines: multidimensional scaling, eigen-decomposition as well as principal manifolds. Neural approaches and adaptive or incremental methods are also reviewed. In the first line, traditional multidimensional scaling (MDS) has been extended not only to be more adaptive such as neural scale, curvilinear component analysis (CCA) and visualization induced self-organizing map (ViSOM) for online learning, but also to be more local scaling such as Isomap for enhanced flexibility for nonlinear data sets. The second line extends linear principal component analysis (PCA) and has attracted a huge amount of interest and enjoyed flourishing advances with methods like kernel PCA (KPCA), locally linear embedding (LLE) and Laplacian eigenmap. The advantage is obvious: a nonlinear problem is transformed into a linear one and a unique solution can then be sought. The third line starts with the nonlinear principal curve and surface and links up with adaptive neural network approaches such as self-organizing map (SOM) and ViSOM. Many of these frameworks have been further improved and enhanced for incremental learning and mapping function generalization. This paper discusses these recent advances and their connections. Their application issues and implementation matters will also be briefly enlightened and commented on.

Modeling Nonlinear Manifolds with Mixtures of Localized Principal Subspaces under a Self-Organizing Framework

Learning nonlinear manifolds based on mixtures of localized linear manifolds under a self-organizing framework

Locally Linear Online Mapping For Mining Low-Dimensional Data Manifolds

Deep Manifold Computing and Visualization

A Local Online Learning Approach for Non-linear Data.

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

Nonlinear Principal Manifolds --- Adaptive Hybrid Learning Approaches

Locally Adaptive Nonlinear Dimensionality Reduction

A Self-Organising Multi-Manifold Learning Algorithm

An Explicit Nonlinear Mapping for Manifold Learning

Advances in adaptive nonlinear manifolds and dimensionality reduction

Bayesian Low-Rank and Sparse Nonlinear Representation for Manifold Clustering

Manifold Mapping Machine

Hierarchic Neighbors Embedding

Efficient Self-Organizing Multilayer Neural Network for Nonlinear System Modeling

Neural Manifold Clustering and Embedding

Noisy Manifold Learning Using Neighborhood Smoothing Embedding

A Distributed Neural Hybrid System Learning Framework in Modeling Complex Dynamical Systems

Nonlinear classification of neural manifolds with contextual information

Exploiting Linear Manifold Features with Parts-Based Representation in Various Scenes.

Locality-preserving Low-Rank Representation for Graph Construction from Nonlinear Manifolds