Abstract:Varying coefficient models have numerous applications in a wide scope of scientific areas. While enjoying nice interpretability, they also allow for flexibility in modeling dynamic impacts of the covariates. But, in the new era of big data, it is challenging to select the relevant variables when the dimensionality is very large. Recently, several works are focused on this important problem based on sparsity assumptions; they are subject to some limitations, however. We introduce an appealing forward selection procedure. It selects important variables sequentially according to a reduction in sum of squares criterion and it employs a Bayesian information criterion (BIC)-based stopping rule. Clearly, it is simple to implement and fast to compute, and possesses many other desirable properties from theoretical and numerical viewpoints. The BIC is a special case of the extended BIC (EBIC) when an extra tuning parameter in the latter vanishes. We establish rigorous screening consistency results when either BIC or EBIC is used as the stopping criterion. The theoretical results depend on some conditions on the eigenvalues related to the design matrices, which can be relaxed in some situations. Results of an extensive simulation study and a real data example are also presented to show the efficacy and usefulness of our procedure. Supplementary materials for this article are available online.

Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models

Forward Variable Selection for Sparse Ultra-High Dimensional Varying Coefficient Models

Faithful Variable Screening for High-Dimensional Convex Regression

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Variable screening in multivariate linear regression with high-dimensional covariates

Forward Regression for Ultra-High Dimensional Variable Screening

Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models

Sequential Feature Screening for Generalized Linear Models with Sparse Ultra-High Dimensional Data

Automatic Variable Selection for High-Dimensional Linear Models with Longitudinal Data

Feature screening and variable selection for partially linear models with ultrahigh-dimensional longitudinal data

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Spline estimator for ultra-high dimensional partially linear varying coefficient models

Profile Greedy Forward Regression Variable Screening for Ultra-High Dimensional Partially Linear Model

Variable Selection for High Dimensional Partially Linear Varying Coefficient Errors-in-variables Models

Ultrahigh dimensional variable selection: beyond the linear model

Greedy Forward Regression for Variable Screening

Variable Selection in High-Dimensional Sparse Multiresponse Linear Regression Models

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Feature Screening in High Dimensional Regression with Endogenous Covariates

Robust Variable Selection for Generalized Linear Models with A Diverging Number of Parameters

Feature Screening for Multi-Response Varying Coefficient Models with Ultrahigh Dimensional Predictors