Abstract:Variable selection is fundamental to high-dimensional statistical modeling, including nonparametric regression. Many approaches in use are stepwise selection procedures, which can be computationally expensive and ignore stochastic errors in the variable selection process. In this article, penalized likelihood approaches are proposed to handle these kinds of problems. The proposed methods select variables and estimate coefficients simultaneously. Hence they enable us to construct confidence intervals for estimated parameters. The proposed approaches are distinguished from others in that the penalty functions are symmetric, nonconcave on (0, ∞), and have singularities at the origin to produce sparse solutions. Furthermore, the penalty functions should be bounded by a constant to reduce bias and satisfy certain conditions to yield continuous solutions. A new algorithm is proposed for optimizing penalized likelihood functions. The proposed ideas are widely applicable. They are readily applied to a variety of parametric models such as generalized linear models and robust regression models. They can also be applied easily to nonparametric modeling by using wavelets and splines. Rates of convergence of the proposed penalized likelihood estimators are established. Furthermore, with proper choice of regularization parameters, we show that the proposed estimators perform as well as the oracle procedure in variable selection; namely, they work as well as if the correct submodel were known. Our simulation shows that the newly proposed methods compare favorably with other variable selection techniques. Furthermore, the standard error formulas are tested to be accurate enough for practical applications.

New Variable Selection for Linear Mixed-Effects Models

Robust Variable Selection in Linear Mixed Models

Double penalized variable selection for high-dimensional partial linear mixed effects models

Variable selection in partially time-varying coefficient models

Variable selection for partially linear single-index varying-coefficient model

Variable Selection for Linear Mixed Effects Model Via Penalization Approaches

Robust variable selection with exponential squared loss for linear mixed-effects models

A New Variable Selection Approach for Varying Coefficient Models

Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties

Variable Selection for Partially Time-Varying Coefficient Error-In-Variables Models

A Unified Variable Selection Approach for Varying Coefficient Models

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Non-Concave Penalization in Linear Mixed-Effects Models and Regularized Selection of Fixed Effects

Variable Selection in Robust Regression Models for Longitudinal Data

New Robust Variable Selection Methods for Linear Regression Models

Robust Variable Selection in Modal Varying-Coefficient Models with Longitudinal

Individualized Multi-directional Variable Selection

Nonparametric Variable Selection and Its Application to Additive Models

A robust and efficient estimation and variable selection method for partially linear single-index models.

Study of Bayesian variable selection method on mixed linear regression models