Abstract:High-dimensional data are commonly seen in modern statistical applications, variable selection methods play indispensable roles in identifying the critical features for scientific discoveries. Traditional best subset selection methods are computationally intractable with a large number of features, while regularization methods such as Lasso, SCAD and their variants perform poorly in ultrahigh-dimensional data due to low computational efficiency and unstable algorithm. Sure screening methods have become popular alternatives by first rapidly reducing the dimension using simple measures such as marginal correlation then applying any regularization methods. A number of screening methods for different models or problems have been developed, however, none of the methods have targeted at data with heavy tailedness, which is another important characteristics of modern big data. In this paper, we propose a robust distance correlation (``RDC'') based sure screening method to perform screening in ultrahigh-dimensional regression with heavy-tailed data. The proposed method shares the same good properties as the original model-free distance correlation based screening while has additional merit of robustly estimating the distance correlation when data is heavy-tailed and improves the model selection performance in screening. We conducted extensive simulations under different scenarios of heavy tailedness to demonstrate the advantage of our proposed procedure as compared to other existing model-based or model-free screening procedures with improved feature selection and prediction performance. We also applied the method to high-dimensional heavy-tailed RNA sequencing (RNA-seq) data of The Cancer Genome Atlas (TCGA) pancreatic cancer cohort and RDC was shown to outperform the other methods in prioritizing the most essential and biologically meaningful genes.

Robust Rank Conditional Feature Screening for Ultrahigh Dimensional Data

Robust Variable Screening for Ultrahigh Dimensional

RObust rank correlation based screening

Robust Sure Independence Screening for Ultrahigh Dimensional Models

Model-free Feature Screening for Ultrahigh Dimensional Censored Regression.

A New Robust Model-Free Feature Screening Method for Ultra-High Dimensional Right Censored Data

A Nonparametric Feature Screening Method for Ultrahigh-Dimensional Missing Response

Spearman Rank Correlation Screening for Ultrahigh-dimensional Censored Data

Conditional Quantile Correlation Screening Procedure for Ultrahigh-Dimensional Varying Coefficient Models

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

Robust Feature Screening for Varying Coefficient Models Via Quantile Partial Correlation

Model-free feature screening for ultrahigh-dimensional data conditional on some variables

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Strong Sure Screening of Ultra-high Dimensional Categorical Data

Robust distance correlation for variable screening

Robust Model-Free Feature Screening Via Quantile Correlation

Robust group variable screening based on maximum Lq-likelihood estimation

Model-free Feature Screening for Ultra-High Dimensional Competing Risks Data

A robust variable screening procedure for ultra-high dimensional data

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Regularized Quantile Regression and Robust Feature Screening for Single Index Models