Abstract:Stochastic kriging is a popular technique for simulation metamodeling due to its exibility and analytical tractability. Its computational bottleneck is the inversion of a covariance matrix, which takes O(n^3) time in general and becomes prohibitive for large n, where n is the number of design points. Moreover, the covariance matrix is often ill-conditioned for large n, and thus the inversion is prone to numerical instability, resulting in erroneous parameter estimation and prediction. These two numerical issues preclude the use of stochastic kriging at a large scale. This paper presents a novel approach to address them. We construct a class of covariance functions, called Markovian covariance functions (MCFs), which have two properties: (i) the associated covariance matrices can be inverted analytically, and (ii) the inverse matrices are sparse. With the use of MCFs, the inversion-related computational time is reduced to O(n^2) in general, and can be further reduced by orders of magnitude with additional assumptions on the simulation errors and design points. The analytical invertibility also enhance the numerical stability dramatically. The key in our approach is that we identify a general functional form of covariance functions that can induce sparsity in the corresponding inverse matrices. We also establish a connection between MCFs and linear ordinary differential equations. Such a connection provides a flexible, principled approach to constructing a wide class of MCFs. Extensive numerical experiments demonstrate that stochastic kriging with MCFs can handle large-scale problems in an both computationally efficient and numerically stable manner.

Full-scale approximations of spatio-temporal covariance models for large datasets

A full scale approximation of covariance functions for large spatial data sets

Covariance approximation for large multivariate spatial data sets with an application to multiple climate model errors

Adaptive Bayesian nonstationary modeling for large spatial datasets using covariance approximations

Smoothed Full-Scale Approximation of Gaussian Process Models for Computation of Large Spatial Datasets

Stationary process approximation for the analysis of large spatial datasets

Efficient History Matching Using the Markov-Chain Monte Carlo Method by Means of the Transformed Adaptive Stochastic Collocation Method

Estimation and Inference for Spatio-Temporal Single-Index Models

Sparse Approximate Inference for Spatio-Temporal Point Process Models

Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data

Computation-Aware Kalman Filtering and Smoothing

Scalable Semiparametric Spatio-temporal Regression for Large Data Analysis

Gaussian predictive process models for large spatial data sets

Modelling local and global phenomena with sparse Gaussian processes

Scalable Stochastic Kriging with Markovian Covariances

Sparse spatially clustered coefficient model via adaptive regularization

Copula‐based Semiparametric Models for Spatiotemporal Data

Dynamic Large Spatial Covariance Matrix Estimation in Application to Semiparametric Model Construction via Variable Clustering: the SCE approach

Flexible Basis Representations for Modeling Large Non-Gaussian Spatial Data

Spatio-Temporal Dynamic Fields Estimating and Modeling of Missing Points in Data Sets Using a Flexible State-Space Model

Semiparametric Estimation of Cross-covariance Functions for Multivariate Random Fields