Abstract:This paper is in response to a recent paper by Hansen (2007) who proposed an optimal model average estimator with weights selected by minimizing a Mallows criterion. The main contribution of Hansen’s paper is a demonstration that the Mallows criterion is asymptotically equivalent to the squared error, so the model average estimator that minimizes the Mallows criterion also minimizes the squared error in large samples. We are concerned with two assumptions that accompany Hansen’s approach. The first is the assumption that the approximating models are strictly nested in a way that depends on the ordering of regressors. Often there is no clear basis for the ordering and the approach does not permit non-nested models which are more realistic from a practical viewpoint. Second, for the optimality result to hold the model weights are required to lie within a special discrete set. In fact, Hansen noted both difficulties and called for extensions of the proof techniques. We provide an alternative proof which shows that the result on the optimality of the Mallows criterion in fact holds for continuous model weights and under a non-nested set-up that allows any linear combination of regressors in the approximating models that make up the model average estimator. These results provide a stronger theoretical basis for the use of the Mallows criterion in model averaging by strengthening existing findings.

Optimal Model Averaging of Varying Coefficient Models

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Optimal Model Averaging for Semiparametric Partially Linear Models with Measurement Errors

Model Averaging Estimation for Varying-Coefficient Single-Index Models

Model Averaging for Semiparametric Varying Coefficient Quantile Regression Models

A Mallows-Type Model Averaging Estimator for the Varying-Coefficient Partially Linear Model

Model averaging estimation for generalized partially linear varying-coefficient models

Model Averaging with Averaging Covariance Matrix

A Mallows-type Model Averaging Estimator for De-Noise Linear Models

Optimal Model Averaging of Mixed-Data Kernel-Weighted Spline Regressions

Optimal Model Averaging Estimator for Multinomial Logit Models

Optimal Model Averaging Estimator for Semi-Functional Partially Linear Models

Penalized Time-Varying Model Averaging

Focused Information Criterion and Model Averaging for Varying-Coefficient Partially Linear Models with Longitudinal Data

Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models

Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data

Least Squares Model Averaging by Mallows Criterion

Model Averaging Procedure for Varying-Coefficient Partially Linear Models with Missing Responses

Model averaging for multivariate multiple regression models

Model Averaging for Generalized Linear Model with Covariates that are Missing completely at Random

Optimal model averaging for partially linear models with missing response variables and error‐prone covariates