Abstract:This paper presents a new approach for Gaussian process (GP) regression for large datasets. The approach involves partitioning the regression input domain into multiple local regions with a different local GP model fitted in each region. Unlike existing local partitioned GP approaches, we introduce a technique for patching together the local GP models nearly seamlessly to ensure that the local GP models for two neighboring regions produce nearly the same response prediction and prediction error variance on the boundary between the two regions. This largely mitigates the well-known discontinuity problem that degrades the boundary accuracy of existing local partitioned GP methods. Our main innovation is to represent the continuity conditions as additional pseudo-observations that the differences between neighboring GP responses are identically zero at an appropriately chosen set of boundary input locations. To predict the response at any input location, we simply augment the actual response observations with the pseudo-observations and apply standard GP prediction methods to the augmented data. In contrast to heuristic continuity adjustments, this has an advantage of working within a formal GP framework, so that the GP-based predictive uncertainty quantification remains valid. Our approach also inherits a sparse block-like structure for the sample covariance matrix, which results in computationally efficient closed-form expressions for the predictive mean and variance. In addition, we provide a new spatial partitioning scheme based on a recursive space partitioning along local principal component directions, which makes the proposed approach applicable for regression domains having more than two dimensions. Using three spatial datasets and three higher dimensional datasets, we investigate the numerical performance of the approach and compare it to several state-of-the-art approaches.

Gaussian Process Regression with Location Errors

Gaussian Processes with Errors in Variables: Theory and Computation

Gaussian Processes with Input Location Error and Applications to the Composite Parts Assembly Process

Gaussian Process Regression Plus Method For Localization Reliability Improvement

Local Linear M‐estimation in Non‐parametric Spatial Regression

Gaussian Process Regression under Computational and Epistemic Misspecification

Bayesian inference for high-dimensional nonstationary Gaussian processes

Gaussian predictive process models for large spatial data sets

Local Gaussian Regression

Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification

A Robust Approach to Gaussian Processes Implementation

Patchwork Kriging for Large-scale Gaussian Process Regression

Episodic Gaussian Process-Based Learning Control with Vanishing Tracking Errors

Mixed-Stationary Gaussian Process for Flexible Non-Stationary Modeling of Spatial Outcomes

Introduction To Gaussian Process Regression In Bayesian Inverse Problems, With New ResultsOn Experimental Design For Weighted Error Measures

Multi-Response Heteroscedastic Gaussian Process Models and Their Inference

Sparse Variational Contaminated Noise Gaussian Process Regression with Applications in Geomagnetic Perturbations Forecasting

Multivariate nearest‐neighbors Gaussian processes with random covariance matrices

Latent Gaussian Process Regression

Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regression

Gaussian Processes with Noisy Regression Inputs for Dynamical Systems