Abstract:For high dimensional statistical models, researchers have begun to focus on situations which can be described as having relatively few moderately large coefficients. Such situations lead to some very subtle statistical problems. In particular, Ingster and Donoho and Jin have considered a sparse normal means testing problem, in which they described the precise demarcation or detection boundary. Meinshausen and Rice have shown that it is even possible to estimate consistently the fraction of nonzero coordinates on a subset of the detectable region, but leave unanswered the question of exactly in which parts of the detectable region consistent estimation is possible. In the present paper we develop a new approach for estimating the fraction of nonzero means for problems where the nonzero means are moderately large. We show that the detection region described by Ingster and Donoho and Jin turns out to be the region where it is possible to consistently estimate the expected fraction of nonzero coordinates. This theory is developed further and minimax rates of convergence are derived. A procedure is constructed which attains the optimal rate of convergence in this setting. Furthermore, the procedure also provides an honest lower bound for confidence intervals while minimizing the expected length of such an interval. Simulations are used to enable comparison with the work of Meinshausen and Rice, where a procedure is given but where rates of convergence have not been discussed. Extensions to more general Gaussian mixture models are also given.

A general robust approach for joint modeling of the family of scale mixture of Normal distribution

A formulation for continuous mixtures of multivariate normal distributions

On mean and/or variance mixtures of normal distributions

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Bayesian estimation and prediction for certain mixtures

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

Scale mixtures of multivariate centered skew-normal distributions

Log-regularly varying scale mixture of normals for robust regression

Robust mixture regression modeling based on two-piece scale mixtures of normal distributions

Estimation and Influence Diagnostics for the Multivariate Linear Regression Models with Skew Scale Mixtures of Normal Distributions

Approximate Inferences for Nonlinear Mixed Effects Models with Scale Mixtures of Skew-Normal Distributions

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

Semisupervised Robust Modeling of Multimode Industrial Processes for Quality Variable Prediction Based on Student's T Mixture Model.

Using mixtures in seemingly unrelated linear regression models with non-normal errors

Robust multivariate mixture regression models with incomplete data

Robust Bayesian model selection for heavy-tailed linear regression using finite mixtures

Families of Parsimonious Finite Mixtures of Regression Models

Reparameterized Scale Mixture of Rayleigh Distribution Regression Models with Varying Precision

Estimation and confidence sets for sparse normal mixtures

The generalized scale mixtures of asymmetric generalized normal distributions with application to stock data

t distribution-based robust semiparametric mixture regression model