Abstract:High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to their representation power. We ask the question whether individual covariates have additional contributions given the latent factors or more generally a set of variables. Our test statistics are based on the estimated partial derivative of the regression function of the candidate variable for screening and a observable proxy for the latent factors. Hence, our test reveals how much predictors contribute additionally to the non-parametric regression after accounting for the latent factors. Our derivative estimator is the convolution of a deep neural network regression estimator and a smoothing kernel. We demonstrate that when the neural network size diverges with the sample size, unlike estimating the regression function itself, it is necessary to smooth the partial derivative of the neural network estimator to recover the desired convergence rate for the derivative. Moreover, our screening test achieves asymptotic normality under the null after finely centering our test statistics that makes the biases negligible, as well as consistency for local alternatives under mild conditions. We demonstrate the performance of our test in a simulation study and two real world applications.

High-dimensional Variable Screening Through Kernel-Based Conditional Mean Dependence

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Faithful Variable Screening for High-Dimensional Convex Regression

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

Adaptive Model-Free Sure Independence Screening

Efficient Feature Screening for Ultrahigh-Dimensional Varying Coefficient Models

A Model-Free Feature Screening Approach Based on Kernel Density Estimation

Strong Sure Screening of Ultra-high Dimensional Categorical Data

Ultrahigh dimensional feature screening for additive model with multivariate response

Robust Variable Screening for Ultrahigh Dimensional

Variable screening in multivariate linear regression with high-dimensional covariates

Sure Independence Screening Adjusted for Confounding Covariates with Ultrahigh-dimensional Data

Quantile Screening for Ultra-High-dimensional Heterogeneous Data Conditional on Some Variables

Model-free feature screening for ultrahigh-dimensional data conditional on some variables

Model-free Feature Screening for Ultra-High Dimensional Competing Risks Data

Conditional nonparametric variable screening by neural factor regression

Ultrahigh dimensional variable selection: beyond the linear model

Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models

Model-free Feature Screening for Ultrahigh Dimensional Data Via a Pearson Chi-Square Based Index

Deep Feature Screening: Feature Selection for Ultra High-Dimensional Data via Deep Neural Networks