Abstract:The Gaussian process (GP) is a widely used probabilistic machine learning method for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear processes. Unlike many other machine learning methods, GPs include an implicit characterization of uncertainty, making them extremely useful across many areas of science, technology, and engineering. Traditional implementations of GPs involve stationary kernels (also termed covariance functions) that limit their flexibility and exact methods for inference that prevent application to data sets with more than about ten thousand points. Modern approaches to address stationarity assumptions generally fail to accommodate large data sets, while all attempts to address scalability focus on approximating the Gaussian likelihood, which can involve subjectivity and lead to inaccuracies. In this work, we explicitly derive an alternative kernel that can discover and encode both sparsity and nonstationarity. We embed the kernel within a fully Bayesian GP model and leverage high-performance computing resources to enable the analysis of massive data sets. We demonstrate the favorable performance of our novel kernel relative to existing exact and approximate GP methods across a variety of synthetic data examples. Furthermore, we conduct space-time prediction based on more than one million measurements of daily maximum temperature and verify that our results outperform state-of-the-art methods in the Earth sciences. More broadly, having access to exact GPs that use ultra-scalable, sparsity-discovering, nonstationary kernels allows GP methods to truly compete with a wide variety of machine learning methods.

Tensor-variate Gaussian processes regression and its application to video surveillance

A Tensor-Variate Gaussian Process for Classification of Multidimensional Structured Data

Tensor Gaussian Process with Contraction for Multi-Channel Imaging Analysis

A spatial Gaussian process method for hyperspectral remote sensing imagery classification

Splatter a Video: Video Gaussian Representation for Versatile Processing

Monocular Tracking 3D People by Gaussian Process Spatio-Temporal Variable Model

Compactly-supported nonstationary kernels for computing exact Gaussian processes on big data

Tensor discriminant analysis on grassmann manifold with application to video based human action recognition

Multiview Variational Sparse Gaussian Processes.

Human motion tracking by temporal-spatial local gaussian process experts

Efficient spatio-temporal Gaussian regression via Kalman filtering

Latent Gaussian Process Regression

tvGP-VAE: Tensor-variate Gaussian Process Prior Variational Autoencoder

Variable Sigma Gaussian Processes: an Expectation Propagation Perspective

Implicit Gaussian process representation of vector fields over arbitrary latent manifolds

Multivariate Gaussian and Student$-t$ Process Regression for Multi-output Prediction

Visual Tracking Via Locally Structured Gaussian Process Regression

Manifold Gaussian Processes for Regression

Tensor Network-Constrained Kernel Machines as Gaussian Processes

Projecting basis functions with tensor networks for Gaussian process regression

Linear Time GPs for Inferring Latent Trajectories from Neural Spike Trains