Abstract:Variable selection in high-dimensional space characterizes many contemporary problems in scientific discovery and decision making. Many frequently-used techniques are based on independence screening; examples include correlation ranking (Fan and Lv, 2008) or feature selection using a two-sample t-test in high-dimensional classification (Tibshirani et al., 2003). Within the context of the linear model, Fan and Lv (2008)showed that this simple correlation ranking possesses a sure independence screening property under certain conditions and that its revision, called iteratively sure independent screening (ISIS), is needed when the features are marginally unrelated but jointly related to the response variable. In this paper, we extend ISIS, without explicit definition of residuals, to a general pseudo-likelihood framework, which includes generalized linear models as a special case. Even in the least-squares setting, the new method improves ISIS by allowing variable deletion in the iterative process. Our technique allows us to select important features in high-dimensional classification where the popularly used two-sample t-method fails. A new technique is introduced to reduce the false discovery rate in the feature screening stage. Several simulated and two real data examples are presented to illustrate the methodology.

Factor Profiled Sure Independence Screening

Factor Profiling for Ultra High Dimensional Variable Selection

Robust variable screening for regression using factor profiling

Faithful Variable Screening for High-Dimensional Convex Regression

Variable screening using factor analysis for high-dimensional data with multicollinearity

Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models

Ultrahigh dimensional variable selection: beyond the linear model

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

Ultrahigh-Dimensional Multiclass Linear Discriminant Analysis by Pairwise Sure Independence Screening

High-dimensional Ordinary Least-squares Projection for Screening Variables

Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models

Profiled Forward Regression for Ultrahigh Dimensional Variable Screening in Semiparametric Partially Linear Models

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Forward Regression for Ultra-High Dimensional Variable Screening

Factor models and variable selection in high-dimensional regression analysis

Projection Correlation Between Scalar and Vector Variables and Its Use in Feature Screening with Multi-Response Data

Feature Screening via Distance Correlation Learning

Penalized Independence Rule for Testing High-Dimensional Hypotheses

A robust variable screening procedure for ultra-high dimensional data

Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models

Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data