Abstract:Dimensionality reduction has long been associated with retinotopic mapping for understanding cortical maps. Multisensory information is processed, fused and mapped to an essentially 2-D cortex in an information preserving manner. Data processing and projection techniques inspired by this biological mechanism are playing an increasingly important role in pattern recognition, computational intelligence, data mining, information retrieval and image recognition. Dimensionality reduction involves reduction of features or volume of data and has become an essential step of information processing in many fields. The topic of manifold learning has recently attracted a great deal of attention, and a number of advanced techniques for extracting nonlinear manifolds and reducing data dimensions have been proposed from statistics, geometry theory and adaptive neural networks. This paper provides an overview of this challenging and emerging topic and discusses various recent methods such as self-organizing map (SOM), kernel PCA, principal manifold, isomap, local linear embedding, and Laplacian eigenmap. Many of them can be considered in a learning manifold framework. The paper further elaborates on the biologically inspired SOM model and its metric preserving variant ViSOM under the framework of adaptive manifold; and their applications in dimensionality reduction with face recognition are investigated. The experiments demonstrate that adaptive ViSOM-based methods produce markedly improved performance over the others due to their metric scaling and preserving properties along the nonlinear manifold.

Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representations

Deep Manifold Transformation for Dimension Reduction

Deep Manifold Computing and Visualization

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

Deep Manifold Transformation for Nonlinear Dimensionality Reduction

Unsupervised detection of semantic correlations in big data

Multimodal Understanding Through Correlation Maximization and Minimization

Inferring Local Structure from Pairwise Correlations

Linear Classification of Neural Manifolds with Correlated Variability

Adaptive nonlinear manifolds and their applications to pattern recognition

The connections between principal component analysis and dimensionality reduction methods of manifolds

On the Versatile Uses of Partial Distance Correlation in Deep Learning

Dimensionality Reduction of Dynamics on Lie Manifolds via Structure-Aware Canonical Correlation Analysis

Joint Characterization of Multiscale Information in High Dimensional Data

Surpassing Cosine Similarity for Multidimensional Comparisons: Dimension Insensitive Euclidean Metric (DIEM)

Nonlinear Principal Manifolds --- Adaptive Hybrid Learning Approaches

Discovering Low-Dimensional Descriptions of Multineuronal Dependencies

A Generalization of the Pearson Correlation to Riemannian Manifolds

Learning High-Dimensional Correspondence Via Manifold Learning and Local Approximation

Adaptive Nonlinear Dimensionality Reduction with a Local Metric.

SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability