Abstract:High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to their representation power. We ask the question whether individual covariates have additional contributions given the latent factors or more generally a set of variables. Our test statistics are based on the estimated partial derivative of the regression function of the candidate variable for screening and a observable proxy for the latent factors. Hence, our test reveals how much predictors contribute additionally to the non-parametric regression after accounting for the latent factors. Our derivative estimator is the convolution of a deep neural network regression estimator and a smoothing kernel. We demonstrate that when the neural network size diverges with the sample size, unlike estimating the regression function itself, it is necessary to smooth the partial derivative of the neural network estimator to recover the desired convergence rate for the derivative. Moreover, our screening test achieves asymptotic normality under the null after finely centering our test statistics that makes the biases negligible, as well as consistency for local alternatives under mild conditions. We demonstrate the performance of our test in a simulation study and two real world applications.

Greedy Forward Regression for Variable Screening

Forward Regression for Ultra-High Dimensional Variable Screening

Faithful Variable Screening for High-Dimensional Convex Regression

Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models

Profiled Forward Regression for Ultrahigh Dimensional Variable Screening in Semiparametric Partially Linear Models

Robust variable screening for regression using factor profiling

Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models

Sure independent screening for functional regression model

Bayesian iterative screening in ultra-high dimensional settings

High-dimensional Ordinary Least-squares Projection for Screening Variables

Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models

RaSE: A Variable Screening Framework via Random Subspace Ensembles

A robust variable screening procedure for ultra-high dimensional data

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Conditional nonparametric variable screening by neural factor regression

A Model-free Variable Screening Method Based on Leverage Score

Sure screening for estimating equations in ultra-high dimensions

Ultrahigh dimensional variable selection: beyond the linear model

Variable Screening for Sparse Online Regression.

Feature screening and variable selection for partially linear models with ultrahigh-dimensional longitudinal data

Variable Screening and Model Averaging for Expectile Regressions