Abstract:An important tool in information analysis is dimensionality reduction. There are various approaches for large data simplification by scaling its dimensions down that play a significant role in recognition and classification tasks. The efficiency of dimension reduction tools is measured in terms of memory and computational complexity, which are usually a function of the number of the given data points. Sparse local operators that involve substantially less than quadratic complexity at one end, and faithful multiscale models with quadratic cost at the other end, make the design of dimension reduction procedure a delicate balance between modeling accuracy and efficiency. Here, we combine the benefits of both and propose a low-dimensional multiscale modeling of the data, at a modest computational cost. The idea is to project the classical multidimensional scaling problem into the data spectral domain extracted from its Laplace-Beltrami operator. There, embedding into a small dimensional Euclidean space is accomplished while optimizing for a small number of coefficients. We provide a theoretical support and demonstrate that working in the natural eigenspace of the data, one could reduce the process complexity while maintaining the model fidelity. As examples, we efficiently canonize nonrigid shapes by embedding their intrinsic metric into , a method often used for matching and classifying almost isometric articulated objects. Finally, we demonstrate the method by exposing the style in which handwritten digits appear in a large collection of images. We also visualize clustering of digits by treating images as feature points that we map to a plane.

On the Schoenberg Transformations in Data Analysis: Theory and Illustrations

Alpha shapes and optimal transport on the sphere

Spectral multidimensional scaling

Differential Geometry for Model Independent Analysis of Images and Other Non-Euclidean Data: Recent Developments

Geometric Characteristics of the Wasserstein Metric on SPD(n) and Its Applications on Data Processing

Sliced-Wasserstein Distances and Flows on Cartan-Hadamard Manifolds

A survey on spectral embeddings and their applications in data analysis

On eigenvalues and eigenfunctions of the operators defining multidimensional scaling on some symmetric spaces

Understanding Higher-Order Interactions in Information Space

Schoenberg Representations and Gramian Matrices of Matérn Functions

A Wasserstein-Type Distance for Gaussian Mixtures on Vector Bundles with Applications to Shape Analysis

Schoenberg's Theorem via the law of large numbers

Variance Inequalities for Transformed Fréchet Means in Hadamard Spaces

Neural Bregman Divergences for Distance Learning

A general theory of singular values with applications to signal denoising

Frames and Finite Dimensionality: Frame Transformation, Classification and Algorithms

Beyond Euclid: An Illustrated Guide to Modern Machine Learning with Geometric, Topological, and Algebraic Structures

Differential geometry with extreme eigenvalues in the positive semidefinite cone

Cartan-Schouten metrics for information geometry and machine learning

Metric Transforms and Low Rank Matrices via Representation Theory of the Real Hyperrectangle

Subspace Data Visualization With Dissimilarity Based On Principal Angle