Abstract:Variable screening is of fundamental importance in linear regression models when the number of predictors far exceeds the number of observations. Multicollinearity is a common phenomenon in high-dimensional settings, in which two or more predictor variables are highly correlated, leading to the notorious difficulty for high-dimensional variable screening. Sure independence screening (SIS) procedure can greatly reduce the dimensionality, but it may break down when the predictors are highly correlated. By combing the factor modelling with SIS, the profiled independence screening (PIS) approach was proposed. However, under a spiked population model, the profiled predictors could not be guaranteed to be uncorrelated and PIS may therefore be misleading. Instead of assuming either the predictors are uncorrelated as in SIS or the profiled predictors are uncorrelated as in PIS, a more general and challenging scenario is considered in which the predictors can be highly correlated. A so-called preconditioned PIS (PPIS) method is proposed that produces asymptotically uncorrelated profiled predictors and thus leads to consistent model selection results under a spiked population model. Compared with PIS, the proposed method could handle the complex multicollinearity case, such as a spiked population model with a slow spectrum decay of population covariance matrix, while keeping the calculation simple. The promising performance of the proposed PPIS method will be illustrated via extensive simulation studies and two real examples.

Interaction screening in high-dimensional multi-response regression via projected distance correlation

Strong Sure Screening of Ultra-high Dimensional Data with Interaction Effects

Projection Correlation Between Scalar and Vector Variables and Its Use in Feature Screening with Multi-Response Data

Ultrahigh dimensional feature screening for additive model with multivariate response

Feature Screening for Multi-Response Varying Coefficient Models with Ultrahigh Dimensional Predictors

An Efficient Model‐free Approach to Interaction Screening for High Dimensional Data

Interaction Pursuit with Feature Screening and Selection

The Kendall Interaction Filter for Variable Interaction Screening in Ultra High Dimensional Classification Problems

High-dimensional Ordinary Least-squares Projection for Screening Variables

Marginal and Interactive Feature Screening of Ultra-high Dimensional Feature Spaces with Multivariate Response

High-Dimensional Variable Screening Under Multicollinearity

An Iterative Approach to Distance Correlation-Based Sure Independence Screening

Sure Independence Screening Adjusted for Confounding Covariates with Ultrahigh-dimensional Data

Feature Screening Via Distance Correlation for Ultrahigh Dimensional Data with Responses Missing at Random

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Dynamic Tilted Current Correlation for High Dimensional Variable Screening

Adaptive Model-Free Sure Independence Screening

Feature Screening in High Dimensional Regression with Endogenous Covariates

Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models

Feature Screening with Latent Responses