Abstract:The distribution of centered Gaussian random fields (GRFs) indexed by compacta such as smooth, bounded Euclidean domains or smooth, compact and orientable manifolds is determined by their covariance operators. We consider centered GRFs given as variational solutions to coloring operator equations driven by spatial white noise, with an elliptic self-adjoint pseudodifferential coloring operator from the Hörmander class. This includes the Matérn class of GRFs as a special case. Using biorthogonal multiresolution analyses on the manifold, we prove that the precision and covariance operators, respectively, may be identified with bi-infinite matrices and finite sections may be diagonally preconditioned rendering the condition number independent of the dimension p of this section. We prove that a tapering strategy by thresholding applied on finite sections of the bi-infinite precision and covariance matrices results in optimally numerically sparse approximations. That is, asymptotically only linearly many nonzero matrix entries are sufficient to approximate the original section of the bi-infinite covariance or precision matrix using this tapering strategy to arbitrary precision. The locations of these nonzero matrix entries can be determined a priori. The tapered covariance or precision matrices may also be optimally diagonally preconditioned. Analysis of the relative size of the entries of the tapered covariance matrices motivates novel, multilevel Monte Carlo (MLMC) oracles for covariance estimation, in sample complexity that scales log-linearly with respect to the number p of parameters. In addition, we propose and analyze novel compressive algorithms for simulating and kriging of GRFs. The complexity (work and memory vs. accuracy) of these three algorithms scales near-optimally in terms of the number of parameters p of the sample-wise approximation of the GRF in Sobolev scales.

A Vecchia Approximation for High-Dimensional Gaussian Cumulative Distribution Functions Arising from Spatial Data

A full scale approximation of covariance functions for large spatial data sets

Vecchia Gaussian Processes: Probabilistic Properties, Minimax Rates and Methodological Developments

Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data

Vecchia Likelihood Approximation for Accurate and Fast Inference in Intractable Spatial Extremes Models

A Variational Approach for Modeling High-dimensional Spatial Generalized Linear Mixed Models

Efficient Modeling of Spatial Extremes over Large Geographical Domains

Gaussian predictive process models for large spatial data sets

Multilevel approximation of Gaussian random fields: Covariance compression, estimation, and spatial prediction

A multivariate Gaussian random field prior against spatial confounding

Hierarchical low rank approximation of likelihoods for large spatial datasets

Nearest-Neighbor Mixture Models for Non-Gaussian Spatial Processes

Implementation and analysis of GPU algorithms for Vecchia Approximation

Semiparametric Estimation of Cross-covariance Functions for Multivariate Random Fields

A Scalable Partitioned Approach to Model Massive Nonstationary Non-Gaussian Spatial Datasets

GPU-Accelerated Vecchia Approximations of Gaussian Processes for Geospatial Data using Batched Matrix Computations

Mixture of Gaussian Processes and its Applications

Bayesian inference for high-dimensional nonstationary Gaussian processes

Differentiability and Approximation of Probability Functions under Gaussian Mixture Models: A Bayesian Approach

Rapid Numerical Approximation Method for Integrated Covariance Functions Over Irregular Data Regions