Abstract:We consider a high-dimensional sparse normal means model where the goal is to estimate the mean vector assuming the proportion of non-zero means is unknown. We model the mean vector by a one-group global-local shrinkage prior belonging to a broad class of such priors that includes the horseshoe prior. We address some questions related to asymptotic properties of the resulting posterior distribution of the mean vector for the said class priors. We consider two ways to model the global parameter in this paper. Firstly by considering this as an unknown fixed parameter and then by an empirical Bayes estimate of it. In the second approach, we do a hierarchical Bayes treatment by assigning a suitable non-degenerate prior distribution to it. We first show that for the class of priors under study, the posterior distribution of the mean vector contracts around the true parameter at a near minimax rate when the empirical Bayes approach is used. Next, we prove that in the hierarchical Bayes approach, the corresponding Bayes estimate attains the minimax risk asymptotically under the squared error loss function. We also show that the posterior contracts around the true parameter at a near minimax rate. These results generalize those of van der Pas et al. (2014) \cite{van2014horseshoe}, (2017) \cite{van2017adaptive}, proved for the horseshoe prior. We have also studied in this work the asymptotic Bayes optimality of global-local shrinkage priors where the number of non-null hypotheses is unknown. Here our target is to propose some conditions on the prior density of the global parameter such that the Bayes risk induced by the decision rule attains Optimal Bayes risk, up to some multiplicative constant. Using our proposed condition, under the asymptotic framework of Bogdan et al. (2011) \cite{bogdan2011asymptotic}, we are able to provide an affirmative answer to satisfy our hunch.

An Empirical Bayes Approach to Shrinkage Estimation on the Manifold of Symmetric Positive-Definite Matrices

A Non-Parametric Shrinkage Mean Estimation for Arbitrary Quadratic Loss Functions and Unknown Covariance Matrices

Shrinkage Estimation for the Diagonal Multivariate Exponential Families

Non-parametric Shrinkage Mean Estimation for Quadratic Loss Functions with Unknown Covariance Matrices

Matrix norm shrinkage estimators and priors

A New Family of Distribution‐Free Geometric Shrinkage Variances Estimators With Applications

Improved estimation of the MSEs and the MSE matrices for shrinkage estimators of multivariate normal means and their applications

Shrinkage MMSE estimators of covariances beyond the zero-mean and stationary variance assumptions

Multifidelity Covariance Estimation via Regression on the Manifold of Symmetric Positive Definite Matrices

Optimal Eigenvalue Shrinkage in the Semicircle Limit

Shrinkage Estimation of the Power Spectrum Covariance Matrix

Polynomials shrinkage estimators of a multivariate normal mean

Nonparametric Stein-type shrinkage covariance matrix estimators in high-dimensional settings

James–Stein Estimation Problem for a Multivariate Normal Random Matrix and an Improved Estimator

Posterior Contraction rate and Asymptotic Bayes Optimality for one-group shrinkage priors in sparse normal means problem

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Shrinking the eigenvalues of M-estimators of covariance matrix

A Geometric Unification of Distributionally Robust Covariance Estimators: Shrinking the Spectrum by Inflating the Ambiguity Set

Eigenvector distributions and optimal shrinkage estimators for large covariance and precision matrices

Multi-Target Shrinkage

Robust Inference of Manifold Density and Geometry by Doubly Stochastic Scaling