Abstract:Strong correlation among predictors and heavy-tailed noises pose a great challenge in the analysis of ultra-high dimensional data. Such challenge leads to an increase in the computation time for discovering active variables and a decrease in selection accuracy. To address this issue, we propose an innovative two-stage screen-then-select approach and its derivative procedure based on a robust quantile regression with sparsity assumption. This approach initially screens important features by ranking quantile ridge estimation and subsequently employs a likelihood-based post-screening selection strategy to refine variable selection. Additionally, we conduct an internal competition mechanism along the greedy search path to enhance the robustness of algorithm against the design dependence. Our methods are simple to implement and possess numerous desirable properties from theoretical and computational standpoints. Theoretically, we establish the strong consistency of feature selection for the proposed methods under some regularity conditions. In empirical studies, we assess the finite sample performance of our methods by comparing them with utility screening approaches and existing penalized quantile regression methods. Furthermore, we apply our methods to identify genes associated with anticancer drug sensitivities for practical guidance.

Profiled Forward Regression for Ultrahigh Dimensional Variable Screening in Semiparametric Partially Linear Models

Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models

Profile Greedy Forward Regression Variable Screening for Ultra-High Dimensional Partially Linear Model

Forward Regression for Ultra-High Dimensional Variable Screening

Factor Profiling for Ultra High Dimensional Variable Selection

Greedy Forward Regression for Variable Screening

Faithful Variable Screening for High-Dimensional Convex Regression

Feature screening and variable selection for partially linear models with ultrahigh-dimensional longitudinal data

Feature Screening in Ultrahigh-Dimensional Partially Linear Models with Missing Responses at Random

Variable screening in multivariate linear regression with high-dimensional covariates

Factor Profiled Sure Independence Screening

Robust variable screening for regression using factor profiling

A semi-parametric approach to feature selection in high-dimensional linear regression models

Sequential profile Lasso for ultra-high-dimensional partially linear models

Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Adaptive Model-Free Sure Independence Screening

Robust Sure Independence Screening for Ultrahigh Dimensional Models

Variable selection for partially linear models via partial correlation

Variable Importance Assessments and Backward Variable Selection for High-Dimensional Data