Abstract:We present an overview of the history of the heat kernel and eigenfunctions on Riemannian manifolds and how the theory has lead to modern methods of analyzing high dimensional data via eigenmaps and other spectral embeddings. We begin with Varadhan's Theorem relating the heat kernel to the distance function on a Riemannian manifold. We then review various theorems which bound the heat kernel on classes of Riemannian manifolds. Next we turn to eigenfunctions, the Sturm-Liouville Decomposition of the heat kernel using eigenfunctions, and various theorems which bound eigenfunctions on classes of Riemannian manifolds. We review various notions of convergence of Riemannian manifolds and which classes of Riemannian manifolds are compact with respect to which notions of convergence. We then present B\'erard-Besson-Gallot's heat kernel embeddings of Riemannian manifolds and the truncation of those embeddings. Finally we turn to Applications of Spectral embeddings to the Dimension Reduction of data sets lying in high dimensional spaces reviewing, in particular, the work of Belkin-Niyogi and Coifman-Lafon. We also review the Spectral Theory of Graphs and the work of Dodziuk and Chung and others. We close with recent theorems of Portegies and of the first author controlling truncated spectral embeddings uniformly on key classes of Riemannian manifolds. Throughout we provide many explicitly computed examples and graphics and attempt to provide as complete a set of references as possible. We hope that this article is accessible to both pure and applied mathematicians working in Geometric Analysis and their doctoral students.

Manifold Embedding of Graphs Using the Heat Kernel

Deep Manifold Computing and Visualization

Sketching the Heat Kernel: Using Gaussian Processes to Embed Data

From Varadhan's Limit to Eigenmaps: A Guide to the Geometric Analysis behind Manifold Learning

Learning Manifold Implicitly via Explicit Heat-Kernel Learning

Embedding Graphs on Grassmann Manifold

Scalable Bayesian inference for heat kernel Gaussian processes on manifolds

Generalised heat kernel invariants of a graph and application to object clustering

A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reduction

MS-IMAP -- A Multi-Scale Graph Embedding Approach for Interpretable Manifold Learning

Conformal Embeddings via Heat Kernel

Constructing heat kernels on infinite graphs

Heat Kernel of Networks with Long-Range Interactions

Spectral embedding and the latent geometry of multipartite networks

The parametrix construction of the heat kernel on a graph

Exploring the Manifold of Neural Networks Using Diffusion Geometry

Graph Laplacians, Riemannian Manifolds and Their Machine-Learning

Hierarchical Neighbors Embedding

The GeometricKernels Package: Heat and Matérn Kernels for Geometric Learning on Manifolds, Meshes, and Graphs

A kernel-based analysis of Laplacian Eigenmaps