Abstract:There has been an intense recent activity in embedding of very high dimensional and nonlinear data structures, much of it in the data science and machine learning literature. We survey this activity in four parts. In the first part we cover nonlinear methods such as principal curves, multidimensional scaling, local linear methods, ISOMAP, graph based methods and diffusion mapping, kernel based methods and random projections. The second part is concerned with topological embedding methods, in particular mapping topological properties into persistence diagrams and the Mapper algorithm. Another type of data sets with a tremendous growth is very high-dimensional network data. The task considered in part three is how to embed such data in a vector space of moderate dimension to make the data amenable to traditional techniques such as cluster and classification techniques. Arguably this is the part where the contrast between algorithmic machine learning methods and statistical modeling, the so-called stochastic block modeling, is at its greatest. In the paper, we discuss the pros and cons for the two approaches. The final part of the survey deals with embedding in $\mathbb{R}^ 2$, i.e. visualization. Three methods are presented: $t$-SNE, UMAP and LargeVis based on methods in parts one, two and three, respectively. The methods are illustrated and compared on two simulated data sets; one consisting of a triplet of noisy Ranunculoid curves, and one consisting of networks of increasing complexity generated with stochastic block models and with two types of nodes.

Histogram-Based Fisher Information Embedding for Manifolds Clustering and Visualization

Deep Manifold Computing and Visualization

Parallel Vector Field Embedding.

Visualization of Financial Data Based on SOM and Gravitational Field Clustering

Neural FIM for learning Fisher Information Metrics from point cloud data

The nonparametric Fisher geometry and the chi-square process density prior

Information Geometry and Statistical Manifold

Principal component analysis and clustering on manifolds

A geometric viewpoint of manifold learning

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Cluster Exploration using Informative Manifold Projections

A New Approach to Discover Interlacing Data Structures in High-Dimensional Space

Statistical embedding: Beyond principal components

The Fisher Geometry and Geodesics of the Multivariate Normals, without Differential Geometry

A Nonparametric Model for Multi-Manifold Clustering with Mixture of Gaussians and Graph Consistency

A Wasserstein-Type Distance for Gaussian Mixtures on Vector Bundles with Applications to Shape Analysis

Isometric Manifold Learning Using Hierarchical Flow.

Intrinsic K-means clustering over homogeneous manifolds

Manifold Learning for Visualizing and Analyzing High-Dimensional Data

The Fisher-Rao geometry of CES distributions

Information Geometric Framework For Point Cloud Data