Abstract:An exhaustive search as required for traditional variable selection methods is impractical in high dimensional statistical modeling. Thus, to conduct variable selection, various forms of penalized estimators with good statistical and computational properties, have been proposed during the past two decades. The attractive properties of these shrinkage and selection estimators, however, depend critically on the size of regularization which controls model complexity. In this paper, we consider the problem of consistent tuning parameter selection in high dimensional sparse linear regression where the dimension of the predictor vector is larger than the size of the sample. First, we propose a family of high dimensional Bayesian Information Criteria (HBIC), and then investigate the selection consistency, extending the results of the extended Bayesian Information Criterion (EBIC), in Chen and Chen (2008) to ultra-high dimensional situations. Second, we develop a two-step procedure, the SIS+AENET, to conduct variable selection in p>n situations. The consistency of tuning parameter selection is established under fairly mild technical conditions. Simulation studies are presented to confirm theoretical findings, and an empirical example is given to illustrate the use in the internet advertising data.

Variable selection of diverging number of parameters under combined penalized likelihood estimations

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Variable Selection in Expectile Regression

Combined-Penalized Likelihood Estimations with A Diverging Number of Parameters

Variable selection via combined penalization in joint mean and variance models

Tuning parameter selector for the penalized likelihood method in multivariate generalized linear models

Quadratic Approximation via the SCAD Penalty with a Diverging Number of Parameters

Variable selection for generalized varying coefficient models with longitudinal data

Variable selection for semiparametric varying-coefficient spatial autoregressive models with a diverging number of parameters

Variable selection for partially linear single-index varying-coefficient model

A MODIFIED BIC TUNING PARAMETER SELECTOR FOR SICA-PENALIZED COX REGRESSION MODELS WITH DIVERGING DIMENSIONALITY

VARIABLE SELECTION FOR COVARIATE ADJUSTED REGRESSION MODEL

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

SCAD Penalized Rank Regression with a Diverging Number of Parameters.

Consistent Tuning Parameter Selection in High-Dimensional Group-Penalized Regression

Robust Variable Selection and Parametric Component Identification in Varying Coefficient Models

Variable Selection Using Penalized Empirical Likelihood

Tuning parameter selection for penalized likelihood estimation of inverse covariance matrix

Consistent Tuning Parameter Selection in High Dimensional Sparse Linear Regression

Variable Selection for Linear Mixed Effects Model Via Penalization Approaches

Shrinkage Tuning Parameter Selection with A Diverging Number of Parameters