Abstract:An exhaustive search as required for traditional variable selection methods is impractical in high dimensional statistical modeling. Thus, to conduct variable selection, various forms of penalized estimators with good statistical and computational properties, have been proposed during the past two decades. The attractive properties of these shrinkage and selection estimators, however, depend critically on the size of regularization which controls model complexity. In this paper, we consider the problem of consistent tuning parameter selection in high dimensional sparse linear regression where the dimension of the predictor vector is larger than the size of the sample. First, we propose a family of high dimensional Bayesian Information Criteria (HBIC), and then investigate the selection consistency, extending the results of the extended Bayesian Information Criterion (EBIC), in Chen and Chen (2008) to ultra-high dimensional situations. Second, we develop a two-step procedure, the SIS+AENET, to conduct variable selection in p>n situations. The consistency of tuning parameter selection is established under fairly mild technical conditions. Simulation studies are presented to confirm theoretical findings, and an empirical example is given to illustrate the use in the internet advertising data.

Variables selection using L 0 penalty

Tuning parameter selection in high dimensional penalized likelihood

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Tuning parameter selector for the penalized likelihood method in multivariate generalized linear models

Tuning parameter selection for penalized likelihood estimation of inverse covariance matrix

Consistent Tuning Parameter Selection in High-Dimensional Group-Penalized Regression

Consistent Tuning Parameter Selection in High Dimensional Sparse Linear Regression

Robust Variable Selection for Generalized Linear Models with A Diverging Number of Parameters

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Variable Selection Via Generalized SELO-Penalized Cox Regression Models

Variable Selection for Linear Mixed Effects Model Via Penalization Approaches

Variable Selection in Quantile Varying Coefficient Models with Longitudinal Data

Generalized Variable Selection Algorithms for Gaussian Process Models by LASSO-like Penalty

Variable selection of diverging number of parameters under combined penalized likelihood estimations

Penalized Generative Variable Selection

Variable selection for generalized varying coefficient models with longitudinal data

A MODIFIED BIC TUNING PARAMETER SELECTOR FOR SICA-PENALIZED COX REGRESSION MODELS WITH DIVERGING DIMENSIONALITY

Variable Selection for Generalized Linear Model with Highly Correlated Covariates

Variable selection for partially linear single-index varying-coefficient model

New Robust Variable Selection Methods for Linear Regression Models

Tuning Parameter Selection in Adaptive LASSO for Quantile Regression with Penal Data