Abstract:Stochastic kriging is a popular technique for simulation metamodeling due to its exibility and analytical tractability. Its computational bottleneck is the inversion of a covariance matrix, which takes O(n^3) time in general and becomes prohibitive for large n, where n is the number of design points. Moreover, the covariance matrix is often ill-conditioned for large n, and thus the inversion is prone to numerical instability, resulting in erroneous parameter estimation and prediction. These two numerical issues preclude the use of stochastic kriging at a large scale. This paper presents a novel approach to address them. We construct a class of covariance functions, called Markovian covariance functions (MCFs), which have two properties: (i) the associated covariance matrices can be inverted analytically, and (ii) the inverse matrices are sparse. With the use of MCFs, the inversion-related computational time is reduced to O(n^2) in general, and can be further reduced by orders of magnitude with additional assumptions on the simulation errors and design points. The analytical invertibility also enhance the numerical stability dramatically. The key in our approach is that we identify a general functional form of covariance functions that can induce sparsity in the corresponding inverse matrices. We also establish a connection between MCFs and linear ordinary differential equations. Such a connection provides a flexible, principled approach to constructing a wide class of MCFs. Extensive numerical experiments demonstrate that stochastic kriging with MCFs can handle large-scale problems in an both computationally efficient and numerically stable manner.

A Nonstationary Designer Space-Time Kernel

Nonstationary covariance functions that model space–time interactions

Nonstationary Spatial Process Models with Spatially Varying Covariance Kernels

Kernel-based Reconstruction of Space-time Functions on Dynamic Graphs

Spatio-Temporal Stationary Covariance Models

Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces II: non-compact symmetric spaces

Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces I: the compact case

Compatibility of Space-Time Kernels with Full, Dynamical, or Compact Support

Space-Time Models based on Random Fields with Local Interactions

Non-separable Covariance Kernels for Spatiotemporal Gaussian Processes based on a Hybrid Spectral Method and the Harmonic Oscillator

Scalable Stochastic Kriging with Markovian Covariances

Krigings over space and time based on latent low-dimensional structures

Positive semidefinite kernels that are axially symmetric on the sphere and stationary in time: spectral and semi-spectral theory, and constructive approaches

Kernel partial least squares for stationary data

Inference of Spatio-Temporal Functions over Graphs via Multi-Kernel Kriged Kalman Filtering

Sample and Computationally Efficient Stochastic Kriging in High Dimensions

Kernels for time series with irregularly-spaced multivariate observations

Spatio-temporal circular models with non-separable covariance structure

Local stationarity and time-inhomogeneous Markov chains

A Unifying Perspective on Non-Stationary Kernels for Deeper Gaussian Processes

Scalable Spatiotemporally Varying Coefficient Modelling with Bayesian Kernelized Tensor Regression