Abstract:Model averaging generally provides better predictions than model selection, but the existing model averaging methods cannot lead to parsimonious models. Parsimony is an especially important property when the number of parameters is large. To achieve a parsimonious model averaging coefficient estimator, we suggest a novel criterion for choosing weights. Asymptotic properties are derived in two practical scenarios: (i) one or more correct models exist in the candidate model set and (ii) all candidate models are misspecified. Under the former scenario, it is proved that our method can put the weight one to the smallest correct model and the resulting model averaging estimators of coefficients have many zeros and thus lead to a parsimonious model. The asymptotic distribution of the estimators is also provided. Under the latter scenario, prediction is mainly focused on and we prove that the proposed procedure is asymptotically optimal in the sense that its squared prediction loss and risk are asymptotically identical to those of the best—but infeasible—model averaging estimator. Numerical analysis shows the promise of the proposed procedure over existing model averaging and selection methods.

Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data

Optimal Model Averaging for Semiparametric Partially Linear Models with Measurement Errors

Model Selection and Model Averaging for Semiparametric Partially Linear Models with Missing Data

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Optimal Model Averaging Estimator for Semi-Functional Partially Linear Models

Model Averaging for Semiparametric Varying Coefficient Quantile Regression Models

Model averaging estimation for generalized partially linear varying-coefficient models

Optimal model averaging for partially linear models with missing response variables and error‐prone covariates

Penalized Time-Varying Model Averaging

Model Averaging for Accelerated Failure Time Models with Missing Censoring Indicators

Model averaging for right censored data with measurement error

Focused Information Criterion and Model Averaging for Varying-Coefficient Partially Linear Models with Longitudinal Data

Model-averaging-based semiparametric modeling for conditional quantile prediction

Model Averaging for Estimating Treatment Effects With Binary Responses

Parsimonious Model Averaging With a Diverging Number of Parameters

Model Averaging by Jackknife Criterion for Varying-Coefficient Partially Linear Models

Partial Linear Model Averaging Prediction for Longitudinal Data

Jackknife Model Averaging for Mixed-Data Kernel-Weighted Spline Quantile Regressions

Model Averaging Procedure for Varying-Coefficient Partially Linear Models with Missing Responses

A Model Averaging Approach for the Ordered Probit and Nested Logit Models with Applications

Model Averaging for Varying Coefficient Partially Linear Models With Missing Data