Abstract:Variable selection is fundamental to high-dimensional statistical modeling, including nonparametric regression. Many approaches in use are stepwise selection procedures, which can be computationally expensive and ignore stochastic errors in the variable selection process. In this article, penalized likelihood approaches are proposed to handle these kinds of problems. The proposed methods select variables and estimate coefficients simultaneously. Hence they enable us to construct confidence intervals for estimated parameters. The proposed approaches are distinguished from others in that the penalty functions are symmetric, nonconcave on (0, ∞), and have singularities at the origin to produce sparse solutions. Furthermore, the penalty functions should be bounded by a constant to reduce bias and satisfy certain conditions to yield continuous solutions. A new algorithm is proposed for optimizing penalized likelihood functions. The proposed ideas are widely applicable. They are readily applied to a variety of parametric models such as generalized linear models and robust regression models. They can also be applied easily to nonparametric modeling by using wavelets and splines. Rates of convergence of the proposed penalized likelihood estimators are established. Furthermore, with proper choice of regularization parameters, we show that the proposed estimators perform as well as the oracle procedure in variable selection; namely, they work as well as if the correct submodel were known. Our simulation shows that the newly proposed methods compare favorably with other variable selection techniques. Furthermore, the standard error formulas are tested to be accurate enough for practical applications.

Variable Selection for Panel Count Data Via Non‐Concave Penalized Estimating Function

Variable selection for recurrent event data via nonconcave penalized estimating function

Variable Selection and Estimation for Multivariate Panel Count Data Via the Seamless‐${\it L}_{{\rm 0}}$ Penalty

Variable selection and estimation for multivariate panel count data via the seamless-${\it L}_{{\rm 0}}$ penalty

Simultaneous variable selection and estimation in semiparametric regression of mixed panel count data

Variable Selection for Mixed Panel Count Data under the Proportional Mean Model.

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Variable selection for joint mean and covariance models via penalized likelihood

Variable Selection for Semiparametric Varying-Coefficient Partially Linear Models with Missing Response at Random

Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties

Flexible variable selection in the presence of missing data

Variable Selection in the Partially Linear Errors-in-variables Models for Longitudinal Data

Robust Variable Selection of Joint Frailty Model for Panel Count Data

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Variable Selection Using Penalized Empirical Likelihood

Variable Selection for Semiparametric Partially Linear Covariate-Adjusted Regression Models

Variable Selection for Longitudinal Data with High-Dimensional Covariates and Dropouts

Variable selection for generalized varying coefficient models with longitudinal data

Variable selection in semiparametric regression modeling

Selection Of Risk Factors For Regression Analysis With Missing Data

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis