Abstract:An important tool in information analysis is dimensionality reduction. There are various approaches for large data simplification by scaling its dimensions down that play a significant role in recognition and classification tasks. The efficiency of dimension reduction tools is measured in terms of memory and computational complexity, which are usually a function of the number of the given data points. Sparse local operators that involve substantially less than quadratic complexity at one end, and faithful multiscale models with quadratic cost at the other end, make the design of dimension reduction procedure a delicate balance between modeling accuracy and efficiency. Here, we combine the benefits of both and propose a low-dimensional multiscale modeling of the data, at a modest computational cost. The idea is to project the classical multidimensional scaling problem into the data spectral domain extracted from its Laplace-Beltrami operator. There, embedding into a small dimensional Euclidean space is accomplished while optimizing for a small number of coefficients. We provide a theoretical support and demonstrate that working in the natural eigenspace of the data, one could reduce the process complexity while maintaining the model fidelity. As examples, we efficiently canonize nonrigid shapes by embedding their intrinsic metric into , a method often used for matching and classifying almost isometric articulated objects. Finally, we demonstrate the method by exposing the style in which handwritten digits appear in a large collection of images. We also visualize clustering of digits by treating images as feature points that we map to a plane.

An Improved LMDS Algorithm.

A Landmark Selection Method for L-Isomap Based on Greedy Algorithm and Its Application

Maximal Linear Embedding for Dimensionality Reduction

Large Scale Spectral Clustering Based On Fast Landmark Sampling

Improved Landslide Susceptibility Mapping Using Unsupervised and Supervised Collaborative Machine Learning Models

SQuadMDS: a lean Stochastic Quartet MDS improving global structure preservation in neighbor embedding like t-SNE and UMAP

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

A quasi-polynomial time algorithm for Multi-Dimensional Scaling via LP hierarchies

A dual basis approach to multidimensional scaling

Distance metric learning by minimal distance maximization

Multi-dimensional Scaling from K-Nearest Neighbourhood Distances

3E-LDA

Continuous Multidimensional Scaling

Laplacian MinMax Discriminant Projection and Its Applications.

Online landmark replacement for out-of-sample dimensionality reduction methods

Fast Spectral Clustering with Landmark-Based Subspace Iteration

SSMD: Dimensionality Reduction and Classification of Hyperspectral Images Based on Spatial–Spectral Manifold Distance Metric Learning

Robust L-Isomap with A Novel Landmark Selection Method

Incremental Regularized Least Squares for Dimensionality Reduction of Large-Scale Data.

Spectral multidimensional scaling