Abstract:The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude varies considerably across the data, e.g., under heteroskedasticity or outliers. In this work, we investigate a more robust alternative -- the doubly stochastic normalization of the Gaussian kernel. We consider a setting where points are sampled from an unknown density on a low-dimensional manifold embedded in high-dimensional space and corrupted by possibly strong, non-identically distributed, sub-Gaussian noise. We establish that the doubly stochastic affinity matrix and its scaling factors concentrate around certain population forms, and provide corresponding finite-sample probabilistic error bounds. We then utilize these results to develop several tools for robust inference under general high-dimensional noise. First, we derive a robust density estimator that reliably infers the underlying sampling density and can substantially outperform the standard kernel density estimator under heteroskedasticity and outliers. Second, we obtain estimators for the pointwise noise magnitudes, the pointwise signal magnitudes, and the pairwise Euclidean distances between clean data points. Lastly, we derive robust graph Laplacian normalizations that accurately approximate various manifold Laplacians, including the Laplace Beltrami operator, improving over traditional normalizations in noisy settings. We exemplify our results in simulations and on real single-cell RNA-sequencing data. For the latter, we show that in contrast to traditional methods, our approach is robust to variability in technical noise levels across cell types.

Density Estimation on Manifolds with Boundary

Adaptive Manifold Density Estimation

Estimating a density near an unknown manifold: a Bayesian nonparametric approach

Level set and density estimation on manifolds

Granulometric Smoothing on Manifolds

Diffusion maps for embedded manifolds with boundary with applications to PDEs

Robust Inference of Manifold Density and Geometry by Doubly Stochastic Scaling

Boundary Estimation from Point Clouds: Algorithms, Guarantees and Applications

Density Estimation Based on Mass

Density Ratio Estimation via Sampling along Generalized Geodesics on Statistical Manifolds

Normal Estimation on Manifolds by Gradient Learning.

Stability of Capillary Hypersurfaces in A Manifold with Density

Only Bayes should learn a manifold (on the estimation of differential geometric structure from data)

Manifold Diffusion Geometry: Curvature, Tangent Spaces, and Dimension

Breaking the curse of dimensionality in structured density estimation

Robust estimation of boundary using doubly stochastic scaling of Gaussian kernel

On the Reduction in Accuracy of Finite Difference Schemes on Manifolds without Boundary

Principal Boundary on Riemannian Manifolds.

A Smeary Central Limit Theorem for Manifolds with Application to High Dimensional Spheres

Data driven Dirichlet sampling on manifolds

The Manifold Density Function: An Intrinsic Method for the Validation of Manifold Learning