Abstract:Recent decades have witnessed a much increased demand for advanced, effective and efficient methods and tools for analyzing, understanding and dealing with data of increasingly complex, high dimensionality and large volume. Whether it is in biology, neuroscience, modern medicine and social sciences or in engineering and computer vision, data are being sampled, collected and cumulated in an unprecedented speed. It is no longer a trivial task to analyze huge amounts of high dimensional data. A systematic, automated way of interpreting data and representing them has become a great challenge facing almost all fields and research in this emerging area has flourished. Several lines of research have embarked on this timely challenge and tremendous progresses and advances have been made recently. Traditional and linear methods are being extended or enhanced in order to meet the new challenges. This paper elaborates on these recent advances and discusses various state-of-the-art algorithms proposed from statistics, geometry and adaptive neural networks. The developments mainly follow three lines: multidimensional scaling, eigen-decomposition as well as principal manifolds. Neural approaches and adaptive or incremental methods are also reviewed. In the first line, traditional multidimensional scaling (MDS) has been extended not only to be more adaptive such as neural scale, curvilinear component analysis (CCA) and visualization induced self-organizing map (ViSOM) for online learning, but also to be more local scaling such as Isomap for enhanced flexibility for nonlinear data sets. The second line extends linear principal component analysis (PCA) and has attracted a huge amount of interest and enjoyed flourishing advances with methods like kernel PCA (KPCA), locally linear embedding (LLE) and Laplacian eigenmap. The advantage is obvious: a nonlinear problem is transformed into a linear one and a unique solution can then be sought. The third line starts with the nonlinear principal curve and surface and links up with adaptive neural network approaches such as self-organizing map (SOM) and ViSOM. Many of these frameworks have been further improved and enhanced for incremental learning and mapping function generalization. This paper discusses these recent advances and their connections. Their application issues and implementation matters will also be briefly enlightened and commented on.

Linear and Nonlinear Dimensionality Reduction from Fluid Mechanics to Machine Learning

Deep Manifold Transformation for Dimension Reduction

Data-driven Dimension Reduction for High-Dimensional Random Vibration Systems with Cubic Nonlinearity

Deep Manifold Computing and Visualization

Deep Manifold Transformation for Nonlinear Dimensionality Reduction

Comparing different nonlinear dimensionality reduction techniques for data-driven unsteady fluid flow modeling

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

Linear Dimensionality Reduction: Survey, Insights, and Generalizations

Nonlinear Manifold Learning and Model Reduction for Transonic Flows

Nonlinear Principal Manifolds --- Adaptive Hybrid Learning Approaches

Adaptive nonlinear manifolds and their applications to pattern recognition

Dimensionality Reduction and Data Visualisation

Advances in adaptive nonlinear manifolds and dimensionality reduction

Challenges and Opportunities for Machine Learning in Fluid Mechanics

Deep convolutional recurrent autoencoders for learning low-dimensional feature dynamics of fluid systems

Data discovery of low dimensional fluid dynamics of turbulent flows

Non-linear Manifold Reduced-Order Models with Convolutional Autoencoders and Reduced Over-Collocation Method

Learning the Latent dynamics of Fluid flows from High-Fidelity Numerical Simulations using Parsimonious Diffusion Maps

Nonlinear Shape-Manifold Learning Approach: Concepts, Tools and Applications

Machine Learning for Fluid Mechanics

Low-dimensional Flow Models from high-dimensional Flow data with Machine Learning and First Principles