Abstract:With rapid advances in information technology, massive datasets are collected in all fields of science, such as biology, chemistry, and social science. Useful or meaningful information is extracted from these data often through statistical learning or model fitting. In massive datasets, both sample size and number of predictors can be large, in which case conventional methods face computational challenges. Recently, an innovative and effective sampling scheme based on leverage scores via singular value decompositions has been proposed to select rows of a design matrix as a surrogate of the full data in linear regression. Analogously, variable screening can be viewed as selecting rows of the design matrix. However, effective variable selection along this line of thinking remains elusive. In this article, we bridge this gap to propose a weighted leverage variable screening method by utilizing both the left and right singular vectors of the design matrix. We show theoretically and empirically that the predictors selected using our method can consistently include true predictors not only for linear models but also for complicated general index models. Extensive simulation studies show that the weighted leverage screening method is highly computationally efficient and effective. We also demonstrate its success in identifying carcinoma related genes using spatial transcriptome data.

Principal Components Adjusted Variable Screening

Faithful Variable Screening for High-Dimensional Convex Regression

Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models

Marginal and Interactive Feature Screening of Ultra-high Dimensional Feature Spaces with Multivariate Response

Bayesian iterative screening in ultra-high dimensional settings

Feature screening and variable selection for partially linear models with ultrahigh-dimensional longitudinal data

A note on marginal correlation based screening

A Model-free Variable Screening Method Based on Leverage Score

Robust variable screening for regression using factor profiling

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Power Analysis of Principal Components Regression in Genetic Association Studies.

Greedy Forward Regression for Variable Screening

Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models

Principal Components Analysis in Clinical Studies

Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models

A robust variable screening procedure for ultra-high dimensional data

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Sure screening for estimating equations in ultra-high dimensions

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

An Adaptive Resampling Test for Detecting the Presence of Significant Predictors