Abstract:Dimension reduction has long been associated with retinotopic mapping for understanding cortical maps and neural information processing. Multisensory information is perceived, propagated and mapped onto the 2-D cortex in a near-optimal information preserving manner. Data visualization, inspired by this mechanism, is playing an increasingly important role in many applications involving feature and data reduction, from biology, neuroscience, decision support, social science, to management science. The topic has also attracted a great deal of attention in computer vision and pattern recognition. Classic linear methods include principal component analysis (PCA), factor analysis, projection pursuit and independent component analysis. Recently there have been considerable efforts and advances in developing methodologies and techniques for nonlinear dimensionality reduction. A number of novel projection methods have been proposed from statistics, geometry theory and neural networks. Two fundamental approaches are multidimensional scaling and nonlinear PCA. This tutorial will provide an introduction to this challenging and demanding topic. Various methods along these lines such as, self-organising maps, kernel PCA, principal manifold, metric and non-metric scaling, isomap, local linear embedding, Laplacian eigenmap, as well as spectral clustering will be explained and discussed. It will also attempt to unify these methods under a constrained self-organising framework. Examples and applications will be shown to illustrate the usefulness and strengthen of various methods, as well their weakness and limitation.

Homology-Preserving Dimensionality Reduction via Manifold Landmarking and Tearing

Deep Manifold Transformation for Dimension Reduction

Deep Manifold Computing and Visualization

Deep Manifold Transformation for Nonlinear Dimensionality Reduction

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

A Tangent Distance Preserving Dimensionality Reduction Algorithm

Stable Local Dimensionality Reduction Approaches

Invertible Manifold Learning for Dimension Reduction

Dimensionality Reduction and Data Visualisation

Principal Manifolds and Nonlinear Dimensionality Reduction Via Tangent Space Alignment

Visualization of Hyperspectral Imaging Data Based on Manifold Alignment

T-Sne for Complex Multi-Manifold High-Dimensional Data

Hierarchical Structuring Of Data On Manifolds

A geometric viewpoint of manifold learning

Neighbourhood-preserving Dimension Reduction Via Localised Multidimensional Scaling

Learning a Stable Local Manifold Representation for Hyperspectral Linear Dimensionality Reduction

Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualization

Finding Representative Landmarks of Data on Manifolds

Linear Dimensionality Reduction Method Based on Topological Properties

A Dimensionality Reduction and Reconstruction Method for Data with Multiple Connected Components

Manifold Learning for Visualizing and Analyzing High-Dimensional Data