Abstract:Kernels are a fundamental technical primitive in machine learning. In recent years, kernel-based methods such as Gaussian processes are becoming increasingly important in applications where quantifying uncertainty is of key interest. In settings that involve structured data defined on graphs, meshes, manifolds, or other related spaces, defining kernels with good uncertainty-quantification behavior, and computing their value numerically, is less straightforward than in the Euclidean setting. To address this difficulty, we present GeometricKernels, a software package which implements the geometric analogs of classical Euclidean squared exponential - also known as heat - and Matérn kernels, which are widely-used in settings where uncertainty is of key interest. As a byproduct, we obtain the ability to compute Fourier-feature-type expansions, which are widely used in their own right, on a wide set of geometric spaces. Our implementation supports automatic differentiation in every major current framework simultaneously via a backend-agnostic design. In this companion paper to the package and its documentation, we outline the capabilities of the package and present an illustrated example of its interface. We also include a brief overview of the theory the package is built upon and provide some historic context in the appendix.

Kernels, data & physics

Kernels, Data & Physics

Statistical physics, Bayesian inference and neural information processing

Physics-informed kernel learning

High-Dimensional Non-Convex Landscapes and Gradient Descent Dynamics

Inferring Kernel $ε$-Machines: Discovering Structure in Complex Systems

Sparse Representations, Inference and Learning

TASI Lectures on Physics for Machine Learning

Physics-informed machine learning as a kernel method

Notes on Deep Learning Theory

NeuralEF: Deconstructing Kernels by Deep Neural Networks.

Modern Machine Learning for LHC Physicists

Statistical Treatment, Fourier and Modal Decomposition

Machine Learning Memory Kernels as Closure for Non-Markovian Stochastic Processes

Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey

The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks

The GeometricKernels Package: Heat and Matérn Kernels for Geometric Learning on Manifolds, Meshes, and Graphs

Physics Informed Deep Kernel Learning