Abstract:Gaussian processes provide a flexible, non-parametric framework for the approximation of functions in high-dimensional spaces. The covariance kernel is the main engine of Gaussian processes, incorporating correlations that underpin the predictive distribution. For applications with spatiotemporal datasets, suitable kernels should model joint spatial and temporal dependence. Separable space-time covariance kernels offer simplicity and computational efficiency. However, non-separable kernels include space-time interactions that better capture observed correlations. Most non-separable kernels that admit explicit expressions are based on mathematical considerations (admissibility conditions) rather than first-principles derivations. We present a hybrid spectral approach for generating covariance kernels which is based on physical arguments. We use this approach to derive a new class of physically motivated, non-separable covariance kernels which have their roots in the stochastic, linear, damped, harmonic oscillator (LDHO). The new kernels incorporate functions with both monotonic and oscillatory decay of space-time correlations. The LDHO covariance kernels involve space-time interactions which are introduced by dispersion relations that modulate the oscillator coefficients. We derive explicit relations for the spatiotemporal covariance kernels in the three oscillator regimes (underdamping, critical damping, overdamping) and investigate their properties. We further illustrate the hybrid spectral method by deriving covariance kernels that are based on the Ornstein-Uhlenbeck model.

Hilbert space valued Gaussian processes, their kernels, factorizations, and covariance structure

Gaussian processes in Non-commutative probability

Canonical data-reconstructions via kernels, Hilbert space-valued Gaussian processes, and quantum states

Positive Definite Kernels, Algorithms, Frames, and Approximations

Operator-Valued Kernels, Machine Learning, and Dynamical Systems

Images of Gaussian and other stochastic processes under closed, densely-defined, unbounded linear operators

New characterizations of reproducing kernel Hilbert spaces and applications to metric geometry

Positive definite kernels and boundary spaces

Invariant kernels on Riemannian symmetric spaces: a harmonic-analytic approach

Matrix valued positive definite kernels related to the generalized Aitken's integral for Gaussians

Generalization of the HSIC and distance covariance using positive definite independent kernels

Reproducing kernels and choices of associated feature spaces, in the form of $L^{2}$-spaces

Non-separable Covariance Kernels for Spatiotemporal Gaussian Processes based on a Hybrid Spectral Method and the Harmonic Oscillator

Wigner kernel and Gabor matrix of operators

Nonuniform sampling, reproducing kernels, and the associated Hilbert spaces

Filtering of Gaussian processes in Hilbert spaces

Invariance of Gaussian RKHSs under Koopman operators of stochastic differential equations with constant matrix coefficients

The Properties of Fractional Gaussian Process and Their Applications

Uniform approximation of common Gaussian process kernels using equispaced Fourier grids