Abstract:Generalized Additive Partial Linear Models (GAPLMs) are appealing for model interpretation and prediction. However, for GAPLMs, the covariates and the degree of smoothing in the nonparametric parts are often difficult to determine in practice. To address this model selection uncertainty issue, we develop a computationally feasible Model Averaging (MA) procedure. The model weights are data-driven and selected based on multifold Cross-Validation (CV) (instead of leave-one-out) for computational saving. When all the candidate models are misspecified, we show that the proposed MA estimator for GAPLMs is asymptotically optimal in the sense of achieving the lowest possible Kullback-Leibler loss. In the other scenario where the candidate model set contains at least one quasi-correct model, the weights chosen by the multifold CV are asymptotically concentrated on the quasi-correct models. As a by-product, we propose a variable importance measure to quantify the importances of the predictors in GAPLMs based on the MA weights. It is shown to be able to asymptotically identify the variables in the true model. Moreover, when the number of candidate models is very large, a model screening method is provided. Numerical experiments show the superiority of the proposed MA method over some existing model averaging and selection methods. for this article are available online.

Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models

Optimal Model Averaging Estimator for Multinomial Logit Models

Unified Optimal Model Averaging with a General Loss Function Based on Cross-Validation

Model Averaging for Generalized Linear Model with Covariates that are Missing completely at Random

Post-averaging inference for optimal model averaging estimator in generalized linear models

Model Averaging Based on Generalized Method of Moments

Optimal Model Averaging for Generalized Partially Linear Single-Index Models

Optimal Model Averaging of Mixed-Data Kernel-Weighted Spline Regressions

Optimal Model Averaging for Semiparametric Partially Linear Models with Measurement Errors

Model averaging estimation for generalized partially linear varying-coefficient models

Penalized Time-Varying Model Averaging

Optimal model averaging for partially linear models with missing response variables and error‐prone covariates

Optimal Model Averaging for Divergent-Dimensional Poisson Regressions

Least Squares Model Averaging Based on Generalized Cross Validation

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Model Averaging for Estimating Treatment Effects With Binary Responses

MODEL AVERAGING BASED ON KULLBACK-LEIBLER DISTANCE.

Optimal Model Averaging of Varying Coefficient Models

Parsimonious Model Averaging With a Diverging Number of Parameters

Multifold Cross-Validation Model Averaging for Generalized Additive Partial Linear Models

On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included