Abstract:We consider a high-dimensional sparse normal means model where the goal is to estimate the mean vector assuming the proportion of non-zero means is unknown. We model the mean vector by a one-group global-local shrinkage prior belonging to a broad class of such priors that includes the horseshoe prior. We address some questions related to asymptotic properties of the resulting posterior distribution of the mean vector for the said class priors. We consider two ways to model the global parameter in this paper. Firstly by considering this as an unknown fixed parameter and then by an empirical Bayes estimate of it. In the second approach, we do a hierarchical Bayes treatment by assigning a suitable non-degenerate prior distribution to it. We first show that for the class of priors under study, the posterior distribution of the mean vector contracts around the true parameter at a near minimax rate when the empirical Bayes approach is used. Next, we prove that in the hierarchical Bayes approach, the corresponding Bayes estimate attains the minimax risk asymptotically under the squared error loss function. We also show that the posterior contracts around the true parameter at a near minimax rate. These results generalize those of van der Pas et al. (2014) \cite{van2014horseshoe}, (2017) \cite{van2017adaptive}, proved for the horseshoe prior. We have also studied in this work the asymptotic Bayes optimality of global-local shrinkage priors where the number of non-null hypotheses is unknown. Here our target is to propose some conditions on the prior density of the global parameter such that the Bayes risk induced by the decision rule attains Optimal Bayes risk, up to some multiplicative constant. Using our proposed condition, under the asymptotic framework of Bogdan et al. (2011) \cite{bogdan2011asymptotic}, we are able to provide an affirmative answer to satisfy our hunch.

Posterior Concentration for Gaussian Process Priors under Rescaled and Hierarchical Matérn and Confluent Hypergeometric Covariance Functions

Contraction rates and projection subspace estimation with Gaussian process priors in high dimension

Adaptive Bayesian Regression on Data with Low Intrinsic Dimensionality

Convergence rates of non-stationary and deep Gaussian process regression

Contraction rates for conjugate gradient and Lanczos approximate posteriors in Gaussian process regression

Posterior consistency of Gaussian process prior for nonparametric binary regression

Convergence of Gaussian Process Regression with Estimated Hyper-Parameters and Applications in Bayesian Inverse Problems

Beyond Matérn: On A Class of Interpretable Confluent Hypergeometric Covariance Functions

A Solution to the Ill-Conditioning of Gradient-Enhanced Covariance Matrices for Gaussian Processes

Posterior Contraction rate and Asymptotic Bayes Optimality for one-group shrinkage priors in sparse normal means problem

Equivalence of Convergence Rates of Posterior Distributions and Bayes Estimators for Functions and Nonparametric Functionals

Posterior Contraction Rates for Matérn Gaussian Processes on Riemannian Manifolds

Posterior Contraction for Empirical Bayesian Approach to Inverse Problems under Non-Diagonal Assumption

Fixed-domain Posterior Contraction Rates for Spatial Gaussian Process Model with Nugget

The Inverse Gamma-Gamma Prior for Optimal Posterior Contraction and Multiple Hypothesis Testing

Posterior Covariance Structures in Gaussian Processes

A posterior contraction for Bayesian inverse problems in Banach spaces

Optimal Gaussian approximations to the posterior for log-linear models with Diaconis-Ylvisaker priors

Inference for Gaussian Processes with Matérn Covariogram on Compact Riemannian Manifolds

Vecchia Gaussian Processes: Probabilistic Properties, Minimax Rates and Methodological Developments