Abstract:Most existing methods of variable selection in partially linear models (PLM) with ultrahigh dimensional covariates are based on partial residuals, which involve a two-step estimation procedure. While the estimation error produced in the first step may have an impact on the second step, multicollinearity among predictors adds additional challenges in the model selection procedure. In this paper, we propose a new Bayesian variable selection approach for PLM. This new proposal addresses those two issues simultaneously as (1) it is a one-step method which selects variables in PLM, even when the dimension of covariates increases at an exponential rate with the sample size, and (2) the method retains model selection consistency, and outperforms existing ones in the setting of highly correlated predictors. Distinguished from existing ones, our proposed procedure employs the difference-based method to reduce the impact from the estimation of the nonparametric component, and incorporates Bayesian subset modeling with diffusing prior (BSM-DP) to shrink the corresponding estimator in the linear component. The estimation is implemented by Gibbs sampling, and we prove that the posterior probability of the true model being selected converges to one asymptotically. Simulation studies support the theory and the efficiency of our methods as compared to other existing ones, followed by an application in a study of supermarket data.

Feature screening and variable selection for partially linear models with ultrahigh-dimensional longitudinal data

Variable Selection for Generalized Partially Linear Models with Longitudinal Data.

Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models

Feature Screening in Ultrahigh-Dimensional Partially Linear Models with Missing Responses at Random

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Sequential Feature Screening for Generalized Linear Models with Sparse Ultra-High Dimensional Data

Variable selection for partially linear models via partial correlation

Automatic Variable Selection for High-Dimensional Linear Models with Longitudinal Data

Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models

Simultaneous Structure Estimation And Variable Selection In Partial Linear Varying Coefficient Models For Longitudinal Data

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Variable screening in multivariate linear regression with high-dimensional covariates

A screening method for ultra-high dimensional features with overlapped partition structures

Variable Selection and Estimation for Partially Linear Single-index Models with Longitudinal Data

Feature Screening for Ultrahigh-Dimensional Additive Logistic Models

Ultrahigh dimensional variable selection: beyond the linear model

Profiled Forward Regression for Ultrahigh Dimensional Variable Screening in Semiparametric Partially Linear Models

Double Penalized Variable Selection Procedure for Partially Linear Models with Longitudinal Data

Feature Screening in High Dimensional Regression with Endogenous Covariates

Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models

Feature screening for multi-response linear models by empirical likelihood