Penalized Independence Rule for Testing High-Dimensional Hypotheses

Yanfeng Shen,Zhengyan Lin,Jun Zhu
DOI: https://doi.org/10.1080/03610926.2010.484160
2011-01-01
Abstract:We consider a challenging problem of testing any possible association between a response variable and a set of predictors, when the dimensionality of predictors is much greater than the number of observations. In the context of generalized linear models, a new approach is proposed for testing against high-dimensional alternatives. Our method uses soft-thresholding to suppress stochastic noise and applies the independence rule to borrow strength across the predictors. Moreover, the method can provide a ranked predictor list and automatically select "important" features to retain in the test statistic. We compare the performance of this method with some competing approaches via real data and simulation studies, demonstrating that our method maintains relatively higher power against a wide family of alternatives.
What problem does this paper attempt to address?