Abstract:Gaussian Processes (GPs) are widely used to model dependency in spatial statistics and machine learning, yet the exact computation suffers an intractable time complexity of $O(n^3)$. Vecchia approximation allows scalable Bayesian inference of GPs in $O(n)$ time by introducing sparsity in the spatial dependency structure that is characterized by a directed acyclic graph (DAG). Despite the popularity in practice, it is still unclear how to choose the DAG structure and there are still no theoretical guarantees in nonparametric settings. In this paper, we systematically study the Vecchia GPs as standalone stochastic processes and uncover important probabilistic properties and statistical results in methodology and theory. For probabilistic properties, we prove that the conditional distributions of the Matérn GPs, as well as the Vecchia approximations of the Matérn GPs, can be characterized by polynomials. This allows us to prove a series of results regarding the small ball probabilities and RKHSs of Vecchia GPs. For statistical methodology, we provide a principled guideline to choose parent sets as norming sets with fixed cardinality and provide detailed algorithms following such guidelines. For statistical theory, we prove posterior contraction rates for applying Vecchia GPs to regression problems, where minimax optimality is achieved by optimally tuned GPs via either oracle rescaling or hierarchical Bayesian methods. Our theory and methodology are demonstrated with numerical studies, where we also provide efficient implementation of our methods in C++ with R interfaces.

Remarks on multivariate Gaussian Process

Kernel Generated Two-Time Parameter Gaussian Processes and Some of Their Path Properties

Local Times of N-parameter Gaussian Processes

Results on Local Times of a Class of Multiparameter Gaussian Processes

Generation of Two Correlated Stationary Gaussian Processes

Path Properties of Kernel Generated Two-Time Parameter Gaussian Processes

Inference for Gaussian Processes with Matérn Covariogram on Compact Riemannian Manifolds

Large-margin multi-view Gaussian process

Manifold Gaussian Processes for Regression

Mixture of Gaussian Processes and its Applications

Quasi-invariant Theorem on the Gaussian Path Space

Multivariate Gaussian and Student$-t$ Process Regression for Multi-output Prediction

The Properties of Fractional Gaussian Process and Their Applications

On large increments and liminfs of a two-parameter Gaussian process

Vecchia Gaussian Processes: Probabilistic Properties, Minimax Rates and Methodological Developments

Images of Gaussian and other stochastic processes under closed, densely-defined, unbounded linear operators

Intrinsic Gaussian Process on Unknown Manifolds with Probabilistic Metrics

A Unifying Framework for Global Gaussianization: Asymptotic Equivalence of Locally Stationary Processes and Bivariate White Noise

Extremes of locally-homogenous vector-valued Gaussian processes

Robust and Conjugate Gaussian Process Regression