Abstract:In this paper, we are concerned with how to select significant variables in semiparametric modeling. Variable selection for semiparametric regression models consists of two components: model selection for nonparametric components and selection of significant variables for the parametric portion. Thus, semiparametric variable selection is much more challenging than parametric variable selection (e.g., linear and generalized linear models) because traditional variable selection procedures including stepwise regression and the best subset selection now require separate model selection for the nonparametric components for each submodel. This leads to a very heavy computational burden. In this paper, we propose a class of variable selection procedures for semiparametric regression models using nonconcave penalized likelihood. We establish the rate of convergence of the resulting estimate. With proper choices of penalty functions and regularization parameters, we show the asymptotic normality of the resulting estimate and further demonstrate that the proposed procedures perform as well as an oracle procedure. A semiparametric generalized likelihood ratio test is proposed to select significant variables in the nonparametric component. We investigate the asymptotic behavior of the proposed test and demonstrate that its limiting null distribution follows a chi-square distribution which is independent of the nuisance parameters. Extensive Monte Carlo simulation studies are conducted to examine the finite sample performance of the proposed variable selection procedures.

Variable Selection for Generalized Linear Model with Highly Correlated Covariates

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Semi-standard partial covariance variable selection when irrepresentable conditions fail

Variable Selection for High Dimensional Partially Linear Varying Coefficient Errors-in-variables Models

Variable Selection for Generalized Partially Linear Models with Longitudinal Data.

Variable Selection for Semiparametric Partially Linear Covariate-Adjusted Regression Models

Variable selection in the high-dimensional continuous generalized linear model with current status data

Variable selection for generalized varying coefficient models with longitudinal data

One-step Sparse Estimates in the Reverse Penalty for High-Dimensional Correlated Data

Variable Selection in High-Dimensional Double Generalized Linear Models

Estimation and model selection in generalized additive partial linear models for correlated data with diverging number of covariates

Variable selection for partially linear models via partial correlation

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Variable Selection in Robust Regression Models for Longitudinal Data

Variable selection in semiparametric regression modeling

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Robust Approach for Variable Selection with High Dimensional Longitudinal Data Analysis

Regularization and variable selection for data with interdependent structures

Robust Variable Selection for Generalized Linear Models with A Diverging Number of Parameters

Variable selection for partially linear single-index varying-coefficient model