Abstract:For high dimensional statistical models, researchers have begun to focus on situations which can be described as having relatively few moderately large coefficients. Such situations lead to some very subtle statistical problems. In particular, Ingster and Donoho and Jin have considered a sparse normal means testing problem, in which they described the precise demarcation or detection boundary. Meinshausen and Rice have shown that it is even possible to estimate consistently the fraction of nonzero coordinates on a subset of the detectable region, but leave unanswered the question of exactly in which parts of the detectable region consistent estimation is possible. In the present paper we develop a new approach for estimating the fraction of nonzero means for problems where the nonzero means are moderately large. We show that the detection region described by Ingster and Donoho and Jin turns out to be the region where it is possible to consistently estimate the expected fraction of nonzero coordinates. This theory is developed further and minimax rates of convergence are derived. A procedure is constructed which attains the optimal rate of convergence in this setting. Furthermore, the procedure also provides an honest lower bound for confidence intervals while minimizing the expected length of such an interval. Simulations are used to enable comparison with the work of Meinshausen and Rice, where a procedure is given but where rates of convergence have not been discussed. Extensions to more general Gaussian mixture models are also given.

A Note on Joint Mix Random Vectors

Joint CLT for Several Random Sesquilinear Forms with Applications to Large-Dimensional Spiked Population Models

On mean and/or variance mixtures of normal distributions

A formulation for continuous mixtures of multivariate normal distributions

Joint Mixability and Notions of Negative Dependence

Strong Approximation for Ρ-Mixing Sequences

LIL Behavior for B-valued Strong Mixing Random Variables

Random games under normal mean–variance mixture distributed independent linear joint chance constraints

Ratios and Cauchy Distribution

On the almost sure invariance principle for dependent Bernoulli random variables

Estimating the mean and variance of a high-dimensional normal distribution using a mixture prior

Random vectors in the presence of a single big jump

Shuffle of Min's Random Variable Approximations of Bivariate Copulas' Realization

Vector Random Fields with Compactly Supported Covariance Matrix Functions

Yurinskii's Coupling for Martingales

Estimation and confidence sets for sparse normal mixtures

A Cramér-Wold theorem for mixtures

On Random Matrices Arising in Deep Neural Networks: General I.I.D. Case

Random projections beyond zero overlap

A Note on Allocation of Portfolio Shares of Random Assets with Archimedean Copula