Abstract:An important tool in information analysis is dimensionality reduction. There are various approaches for large data simplification by scaling its dimensions down that play a significant role in recognition and classification tasks. The efficiency of dimension reduction tools is measured in terms of memory and computational complexity, which are usually a function of the number of the given data points. Sparse local operators that involve substantially less than quadratic complexity at one end, and faithful multiscale models with quadratic cost at the other end, make the design of dimension reduction procedure a delicate balance between modeling accuracy and efficiency. Here, we combine the benefits of both and propose a low-dimensional multiscale modeling of the data, at a modest computational cost. The idea is to project the classical multidimensional scaling problem into the data spectral domain extracted from its Laplace-Beltrami operator. There, embedding into a small dimensional Euclidean space is accomplished while optimizing for a small number of coefficients. We provide a theoretical support and demonstrate that working in the natural eigenspace of the data, one could reduce the process complexity while maintaining the model fidelity. As examples, we efficiently canonize nonrigid shapes by embedding their intrinsic metric into , a method often used for matching and classifying almost isometric articulated objects. Finally, we demonstrate the method by exposing the style in which handwritten digits appear in a large collection of images. We also visualize clustering of digits by treating images as feature points that we map to a plane.

Multidimensional Smoothing Using Orthogonal Expansions

A General Technique for Smoothing Multi-Dimensional Datasets Utilizing Orthogonal Expansions and Lower Dimensional Smoothers.

A General Approach for Multidimensional Smoothing

Orthogonal projection analysis

Adaptive Penalized Splines for Data Smoothing

Robust thin-plate splines for multivariate spatial smoothing

Spectral multidimensional scaling

Efficient estimation for a smoothing thin plate spline in a two-dimensional space

Adaptive Dimensionality-Reduction for Time-Stepping in Differential and Partial Differential Equations

Hessian Based Smoothing Splines for Manifold Learning

Random Smoothing Regularization in Kernel Gradient Descent Learning

Smoothing and parameter estimation by soft-adherence to governing equations

Efficient Computation of Smoothing Splines Via Adaptive Basis Sampling

Doubly Robust Smoothing of Dynamical Processes via Outlier Sparsity Constraints

Adaptive functional principal components analysis

Aspects of 2D-Adaptive Fourier Decompositions

Image Smoothing via Multiscale Global Perception

On smoothing in non autonomous Ornstein-Uhlenbeck equations in infinite dimensions

An Efficient and Accurate Interpolation Strategy for Multi-Dimensional Functions

Dimension Reduction and Smoothing in Quasi-Monte Carlo Method for Financial Engineering

An Asympirical Smoothing Parameters Selection Approach for Smoothing Spline ANOVA Models in Large Samples