Abstract:In nonparameteric Bayesian approaches, Gaussian stochastic processes can serve as priors on real-valued function spaces. Existing literature on the posterior convergence rates under Gaussian process priors shows that it is possible to achieve optimal or near-optimal posterior contraction rates if the smoothness of the Gaussian process matches that of the target function. Among those priors, Gaussian processes with a parametric Matérn covariance function is particularly notable in that its degree of smoothness can be determined by a dedicated smoothness parameter. \citet{ma2022beyond} recently introduced a new family of covariance functions called the Confluent Hypergeometric (CH) class that simultaneously possess two parameters: one controls the tail index of the polynomially decaying covariance function, and the other parameter controls the degree of mean-squared smoothness analogous to the Matérn class. In this paper, we show that with proper choice of rescaling parameters in the Matérn and CH covariance functions, it is possible to obtain the minimax optimal posterior contraction rate for $\eta$-regular functions for nonparametric regression model with fixed design. Unlike the previous results for unrescaled cases, the smoothness parameter of the covariance function need not equal $\eta$ for achieving the optimal minimax rate, for either rescaled Matérn or rescaled CH covariances, illustrating a key benefit for rescaling. We also consider a fully Bayesian treatment of the rescaling parameters and show the resulting posterior distributions still contract at the minimax-optimal rate. The resultant hierarchical Bayesian procedure is fully adaptive to the unknown true smoothness.

Conjunction probability of smooth centered Gaussian processes

On the Probability of Conjunctions of Stationary Gaussian Processes

LIMIT BEHAVIORS FOR THE INCREMENTS OF A D-Dimensional MULTI-PARAMETER GAUSSIAN PROCESS

Asymptotic Bounds for Smoothness Parameter Estimates in Gaussian Process Interpolation

A covariance formula for the number of excursion set components of Gaussian fields and applications

Convergence of Gaussian process regression: Optimality, robustness, and relationship with kernel ridge regression

The expected Euler characteristic approximation to excursion probabilities of smooth Gaussian random fields with general variance functions

On Generalized Sub-Gaussian Canonical Processes and Their Applications

Inference for Gaussian Processes with Matérn Covariogram on Compact Riemannian Manifolds

Extremes of locally-homogenous vector-valued Gaussian processes

Conditioning of Banach Space Valued Gaussian Random Variables: An Approximation Approach Based on Martingales

On the best approximation by finite Gaussian mixtures

On the Inference of Applying Gaussian Process Modeling to a Deterministic Function

A covariance representation and an elementary proof of the Gaussian concentration inequality

Posterior Concentration for Gaussian Process Priors under Rescaled and Hierarchical Matérn and Confluent Hypergeometric Covariance Functions

Differentiability and Approximation of Probability Functions under Gaussian Mixture Models: A Bayesian Approach

On Some Asymptotic Properties and an Almost Sure Approximation of the Normalized Inverse-Gaussian Process

Bounds on the Bethe Free Energy for Gaussian Networks

A Cramér-Wold theorem for mixtures

Spectral convergence of probability densities for forward problems in uncertainty quantification

Remarks on multivariate Gaussian Process