Abstract:In nonparameteric Bayesian approaches, Gaussian stochastic processes can serve as priors on real-valued function spaces. Existing literature on the posterior convergence rates under Gaussian process priors shows that it is possible to achieve optimal or near-optimal posterior contraction rates if the smoothness of the Gaussian process matches that of the target function. Among those priors, Gaussian processes with a parametric Matérn covariance function is particularly notable in that its degree of smoothness can be determined by a dedicated smoothness parameter. \citet{ma2022beyond} recently introduced a new family of covariance functions called the Confluent Hypergeometric (CH) class that simultaneously possess two parameters: one controls the tail index of the polynomially decaying covariance function, and the other parameter controls the degree of mean-squared smoothness analogous to the Matérn class. In this paper, we show that with proper choice of rescaling parameters in the Matérn and CH covariance functions, it is possible to obtain the minimax optimal posterior contraction rate for $\eta$-regular functions for nonparametric regression model with fixed design. Unlike the previous results for unrescaled cases, the smoothness parameter of the covariance function need not equal $\eta$ for achieving the optimal minimax rate, for either rescaled Matérn or rescaled CH covariances, illustrating a key benefit for rescaling. We also consider a fully Bayesian treatment of the rescaling parameters and show the resulting posterior distributions still contract at the minimax-optimal rate. The resultant hierarchical Bayesian procedure is fully adaptive to the unknown true smoothness.

Adaptive Bayesian estimation using a Gaussian random field with inverse Gamma bandwidth

Adaptive Bayesian Regression on Data with Low Intrinsic Dimensionality

Adaptive nonparametric Bayesian inference using location-scale mixture priors

Posterior sampling with Adaptive Gaussian Processes in Bayesian parameter identification

Adaptive Bayesian density estimation using Pitman-Yor or normalized inverse-Gaussian process kernel mixtures

Adaptive Gaussian Process Regression for Bayesian inverse problems

Posterior Concentration for Gaussian Process Priors under Rescaled and Hierarchical Matérn and Confluent Hypergeometric Covariance Functions

Bayesian inference for high-dimensional nonstationary Gaussian processes

Sparse reconstructions from few noisy data: analysis of hierarchical Bayesian models with generalized gamma hyperpriors

An adaptive Gaussian process method for multi-modal Bayesian inverse problems

Empirical Bayes inference in sparse high-dimensional generalized linear models

Posterior Contraction for Empirical Bayesian Approach to Inverse Problems under Non-Diagonal Assumption

Nonparametric Bayesian estimation in a multidimensional diffusion model with high frequency data

Convergence of Gaussian Process Regression with Estimated Hyper-Parameters and Applications in Bayesian Inverse Problems

Fast sampling of parameterised Gaussian random fields

An empirical Bayes procedure for the selection of Gaussian graphical models

The Inverse Gamma-Gamma Prior for Optimal Posterior Contraction and Multiple Hypothesis Testing

Iterative Construction of Gaussian Process Surrogate Models for Bayesian Inference

Adaptive Bayesian multivariate density estimation with Dirichlet mixtures

Ideal Bayesian Spatial Adaptation