Abstract:This paper is in response to a recent paper by Hansen (2007) who proposed an optimal model average estimator with weights selected by minimizing a Mallows criterion. The main contribution of Hansen’s paper is a demonstration that the Mallows criterion is asymptotically equivalent to the squared error, so the model average estimator that minimizes the Mallows criterion also minimizes the squared error in large samples. We are concerned with two assumptions that accompany Hansen’s approach. The first is the assumption that the approximating models are strictly nested in a way that depends on the ordering of regressors. Often there is no clear basis for the ordering and the approach does not permit non-nested models which are more realistic from a practical viewpoint. Second, for the optimality result to hold the model weights are required to lie within a special discrete set. In fact, Hansen noted both difficulties and called for extensions of the proof techniques. We provide an alternative proof which shows that the result on the optimality of the Mallows criterion in fact holds for continuous model weights and under a non-nested set-up that allows any linear combination of regressors in the approximating models that make up the model average estimator. These results provide a stronger theoretical basis for the use of the Mallows criterion in model averaging by strengthening existing findings.

Least Squares Model Averaging Based on Generalized Cross Validation

Model Averaging Based on Leave-Subject-out Cross-Validation

Unified Optimal Model Averaging with a General Loss Function Based on Cross-Validation

Cross-Validation Model Averaging for Generalized Functional Linear Model

Model Averaging Based on Generalized Method of Moments

Model Averaging by Cross-validation for Partially Linear Functional Additive Models

Penalized Time-Varying Model Averaging

Model averaging prediction by K -fold cross-validation

A Scalable Frequentist Model Averaging Method

Averaging Estimators for Discrete Choice by M-fold Cross-Validation

Optimal Model Averaging Estimator for Semi-Functional Partially Linear Models

Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models

On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Least Squares Model Averaging for Two Non-Nested Linear Models

Optimal model averaging based on forward-validation

Model Averaging Based on Leave-Subject-out Cross-Validation for Vector Autoregressions

Jackknife Model Averaging for Mixed-Data Kernel-Weighted Spline Quantile Regressions

Least Squares Model Averaging by Mallows Criterion

Kriging Model Averaging Based on Leave-One-Out Cross-Validation Method

Optimal Model Averaging for Generalized Partially Linear Single-Index Models