Abstract:Most existing methods of variable selection in partially linear models (PLM) with ultrahigh dimensional covariates are based on partial residuals, which involve a two-step estimation procedure. While the estimation error produced in the first step may have an impact on the second step, multicollinearity among predictors adds additional challenges in the model selection procedure. In this paper, we propose a new Bayesian variable selection approach for PLM. This new proposal addresses those two issues simultaneously as (1) it is a one-step method which selects variables in PLM, even when the dimension of covariates increases at an exponential rate with the sample size, and (2) the method retains model selection consistency, and outperforms existing ones in the setting of highly correlated predictors. Distinguished from existing ones, our proposed procedure employs the difference-based method to reduce the impact from the estimation of the nonparametric component, and incorporates Bayesian subset modeling with diffusing prior (BSM-DP) to shrink the corresponding estimator in the linear component. The estimation is implemented by Gibbs sampling, and we prove that the posterior probability of the true model being selected converges to one asymptotically. Simulation studies support the theory and the efficiency of our methods as compared to other existing ones, followed by an application in a study of supermarket data.

Variable Selection in Joint Modelling of the Mean and Variance for Hierarchical Data

An Improved Algorithm for High-Dimensional Continuous Threshold Expectile Model with Variance Heterogeneity

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Bayesian estimation for longitudinal data in a joint model with HPCs

Group Regularized Estimation under Structural Hierarchy

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

A High-dimensional M-estimator Framework for Bi-level Variable Selection

Variable selection in subdistribution hazard frailty models with competing risks data

Variable selection in Bayesian generalized linear-mixed models: an illustration using candidate gene case-control association studies

Variable Selection for Linear Mixed Effects Model Via Penalization Approaches

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Variable Selection for High-dimensional Generalized Linear Models using an Iterated Conditional Modes/Medians Algorithm

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Variable Selection in Quantile Varying Coefficient Models with Longitudinal Data

Bayesian variable selection in joint modeling of longitudinal data and interval-censored failure time data

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Variable Selection for Hidden Markov Models with Continuous Variables and Missing Data

High-dimensional variable selection accounting for heterogeneity in regression coefficients across multiple data sources

Fast maximum likelihood estimation for general hierarchical models

Bayesian Sparse Global-Local Shrinkage Regression for Selection of Grouped Variables