Abstract:This paper is concerned with screening features in ultrahigh dimensional data analysis, which has become increasingly important in diverse scientific fields. We develop a sure independence screening procedure based on the distance correlation (DC-SIS, for short). The DC-SIS can be implemented as easily as the sure independence screening procedure based on the Pearson correlation (SIS, for short) proposed by Fan and Lv (2008). However, the DC-SIS can significantly improve the SIS. Fan and Lv (2008) established the sure screening property for the SIS based on linear models, but the sure screening property is valid for the DC-SIS under more general settings including linear models. Furthermore, the implementation of the DC-SIS does not require model specification (e.g., linear model or generalized linear model) for responses or predictors. This is a very appealing property in ultrahigh dimensional data analysis. Moreover, the DC-SIS can be used directly to screen grouped predictor variables and for multivariate response variables. We establish the sure screening property for the DC-SIS, and conduct simulations to examine its finite sample performance. Numerical comparison indicates that the DC-SIS performs much better than the SIS in various models. We also illustrate the DC-SIS through a real data example.

Sure Independence Screening Adjusted for Confounding Covariates with Ultrahigh-dimensional Data

Adaptive Model-Free Sure Independence Screening

Feature Screening for Ultrahigh-dimensional Censored Data with Varying Coefficient Single-index Model

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

A Post-Screening Diagnostic Study for Ultrahigh Dimensional Data

Robust Sure Independence Screening for Ultrahigh Dimensional Models

A Generic Sure Independence Screening Procedure

Model-free feature screening for ultrahigh-dimensional data conditional on some variables

Strong Sure Screening of Ultra-high Dimensional Categorical Data

Nonparametric screening for additive quantile regression in ultra-high dimension

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Strong Sure Screening of Ultra-high Dimensional Data with Interaction Effects

Factor Profiled Sure Independence Screening

Quantile Screening for Ultra-High-dimensional Heterogeneous Data Conditional on Some Variables

Independent screening for single-index hazard rate models with ultra-high dimensional features

Feature Screening via Distance Correlation Learning

An Iterative Approach to Distance Correlation-Based Sure Independence Screening

Ultrahigh-Dimensional Multiclass Linear Discriminant Analysis by Pairwise Sure Independence Screening

Model-free Sure Screening Via Maximum Correlation.

Feature Screening in High Dimensional Regression with Endogenous Covariates