Abstract:High-dimensional data are commonly seen in modern statistical applications, variable selection methods play indispensable roles in identifying the critical features for scientific discoveries. Traditional best subset selection methods are computationally intractable with a large number of features, while regularization methods such as Lasso, SCAD and their variants perform poorly in ultrahigh-dimensional data due to low computational efficiency and unstable algorithm. Sure screening methods have become popular alternatives by first rapidly reducing the dimension using simple measures such as marginal correlation then applying any regularization methods. A number of screening methods for different models or problems have been developed, however, none of the methods have targeted at data with heavy tailedness, which is another important characteristics of modern big data. In this paper, we propose a robust distance correlation (``RDC'') based sure screening method to perform screening in ultrahigh-dimensional regression with heavy-tailed data. The proposed method shares the same good properties as the original model-free distance correlation based screening while has additional merit of robustly estimating the distance correlation when data is heavy-tailed and improves the model selection performance in screening. We conducted extensive simulations under different scenarios of heavy tailedness to demonstrate the advantage of our proposed procedure as compared to other existing model-based or model-free screening procedures with improved feature selection and prediction performance. We also applied the method to high-dimensional heavy-tailed RNA sequencing (RNA-seq) data of The Cancer Genome Atlas (TCGA) pancreatic cancer cohort and RDC was shown to outperform the other methods in prioritizing the most essential and biologically meaningful genes.

Quantile Correlation‐Based Sufficient Variable Screening by Controlling False Discovery Rate

Faithful Variable Screening for High-Dimensional Convex Regression

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Nonparametric screening for additive quantile regression in ultra-high dimension

Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models

Feature Screening for High-Dimensional Survival Data Via Censored Quantile Correlation

False discovery control for penalized variable selections with high-dimensional covariates.

Feature Screening via Distance Correlation Learning

Distributed Conditional Feature Screening via Pearson Partial Correlation with FDR Control

Distribution-free and Model-free Multivariate Feature Screening via Multivariate Rank Distance Correlation

Adaptive sufficient sparse clustering by controlling false discovery

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

The Conditional Prediction Function: A Novel Technique to Control False Discovery Rate for Complex Models

Controlling the False Discovery Rate for Binary Feature Selection via Knockoff

Robust distance correlation for variable screening

False Variable Selection Rates in Regression

Controlled Variable Selection from Summary Statistics Only? A Solution via GhostKnockoffs and Penalized Regression

Ultrahigh Dimensional Feature Selection via Kernel Canonical Correlation Analysis

Ultrahigh dimensional variable selection: beyond the linear model

Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models

Semi-Penalized Inference with Direct False Discovery Rate Control in High-Dimensions