Abstract:For high dimensional statistical models, researchers have begun to focus on situations which can be described as having relatively few moderately large coefficients. Such situations lead to some very subtle statistical problems. In particular, Ingster and Donoho and Jin have considered a sparse normal means testing problem, in which they described the precise demarcation or detection boundary. Meinshausen and Rice have shown that it is even possible to estimate consistently the fraction of nonzero coordinates on a subset of the detectable region, but leave unanswered the question of exactly in which parts of the detectable region consistent estimation is possible. In the present paper we develop a new approach for estimating the fraction of nonzero means for problems where the nonzero means are moderately large. We show that the detection region described by Ingster and Donoho and Jin turns out to be the region where it is possible to consistently estimate the expected fraction of nonzero coordinates. This theory is developed further and minimax rates of convergence are derived. A procedure is constructed which attains the optimal rate of convergence in this setting. Furthermore, the procedure also provides an honest lower bound for confidence intervals while minimizing the expected length of such an interval. Simulations are used to enable comparison with the work of Meinshausen and Rice, where a procedure is given but where rates of convergence have not been discussed. Extensions to more general Gaussian mixture models are also given.

Robust estimation for mixtures of Gaussian factor analyzers, based on trimming and constraints

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Finite Mixtures of Multivariate Poisson-Log Normal Factor Analyzers for Clustering Count Data

Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach

Recursive Mixture Factor Analyzer for Monitoring Multimode Time-Variant Industrial Processes

Improving model choice in classification: an approach based on clustering of covariance matrices

Estimation of Gaussian mixtures in small sample studies using $l_1$ penalization

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components

Model-based clustering based on sparse finite Gaussian mixtures

Component-wise Adaptive Trimming For Robust Mixture Regression

Fast ML Estimation for the Mixture of Factor Analyzers Via an ECM Algorithm

Probabilistic Inference from Arbitrary Uncertainty using Mixtures of Factorized Generalized Gaussians

A factor mixture analysis model for multivariate binary data

Factor Model of Mixtures

Overfitting Bayesian Mixtures of Factor Analyzers with an Unknown Number of Components

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

Model-based clustering via mixtures of unrestricted skew normal factor analyzers with complete and incomplete data

Infinite Mixtures of Infinite Factor Analysers

Estimation and confidence sets for sparse normal mixtures

Unsupervised Classification with a Family of Parsimonious Contaminated Shifted Asymmetric Laplace Mixtures