Abstract:The Gaussian process (GP) is a widely used probabilistic machine learning method for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear processes. Unlike many other machine learning methods, GPs include an implicit characterization of uncertainty, making them extremely useful across many areas of science, technology, and engineering. Traditional implementations of GPs involve stationary kernels (also termed covariance functions) that limit their flexibility and exact methods for inference that prevent application to data sets with more than about ten thousand points. Modern approaches to address stationarity assumptions generally fail to accommodate large data sets, while all attempts to address scalability focus on approximating the Gaussian likelihood, which can involve subjectivity and lead to inaccuracies. In this work, we explicitly derive an alternative kernel that can discover and encode both sparsity and nonstationarity. We embed the kernel within a fully Bayesian GP model and leverage high-performance computing resources to enable the analysis of massive data sets. We demonstrate the favorable performance of our novel kernel relative to existing exact and approximate GP methods across a variety of synthetic data examples. Furthermore, we conduct space-time prediction based on more than one million measurements of daily maximum temperature and verify that our results outperform state-of-the-art methods in the Earth sciences. More broadly, having access to exact GPs that use ultra-scalable, sparsity-discovering, nonstationary kernels allows GP methods to truly compete with a wide variety of machine learning methods.

Variable Hyperparameterized Gaussian Kernel using Displaced Squeezed Vacuum State

Quantum Kernel Machine Learning With Continuous Variables

Variational Quantum Kernels with Task-Specific Quantum Metric Learning

Enhancing Quantum Machine Learning: The Power of Non-Linear Optical Reproducing Kernels

Learning ground states of gapped quantum Hamiltonians with Kernel Methods

Continuous-variable quantum kernel method on a programmable photonic quantum processor

Non-Gaussian and Gottesman-Kitaev-Preskill state preparation by photon catalysis

A Hyperparameter Study for Quantum Kernel Methods

Kernel Alignment for Quantum Support Vector Machines Using Genetic Algorithms

Unitary-transformed projective squeezing: applications for circuit-knitting and state-preparation of non-Gaussian states

Benchmarking of quantum fidelity kernels for Gaussian process regression

Quantum Kernel t-Distributed Stochastic Neighbor Embedding

Easy representation of multivariate functions with low-dimensional terms via Gaussian process regression kernel design: applications to machine learning of potential energy surfaces and kinetic energy densities from sparse data

Canonical data-reconstructions via kernels, Hilbert space-valued Gaussian processes, and quantum states

Effect of alternating layered ansatzes on trainability of projected quantum kernel

Quantum-Classical Multiple Kernel Learning

Faster variational quantum algorithms with quantum kernel-based surrogate models

Experimental demonstration of Gaussian boson sampling with displacement

Kernelized Product Quantization.

A quantum hardware-induced graph kernel based on Gaussian Boson Sampling

Compactly-supported nonstationary kernels for computing exact Gaussian processes on big data