Abstract:This paper is in response to a recent paper by Hansen (2007) who proposed an optimal model average estimator with weights selected by minimizing a Mallows criterion. The main contribution of Hansen’s paper is a demonstration that the Mallows criterion is asymptotically equivalent to the squared error, so the model average estimator that minimizes the Mallows criterion also minimizes the squared error in large samples. We are concerned with two assumptions that accompany Hansen’s approach. The first is the assumption that the approximating models are strictly nested in a way that depends on the ordering of regressors. Often there is no clear basis for the ordering and the approach does not permit non-nested models which are more realistic from a practical viewpoint. Second, for the optimality result to hold the model weights are required to lie within a special discrete set. In fact, Hansen noted both difficulties and called for extensions of the proof techniques. We provide an alternative proof which shows that the result on the optimality of the Mallows criterion in fact holds for continuous model weights and under a non-nested set-up that allows any linear combination of regressors in the approximating models that make up the model average estimator. These results provide a stronger theoretical basis for the use of the Mallows criterion in model averaging by strengthening existing findings.

Model Averaging with Averaging Covariance Matrix

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Model averaging in a multiplicative heteroscedastic model

MODEL AVERAGING BASED ON KULLBACK-LEIBLER DISTANCE.

Model averaging for right censored data with measurement error

Least Squares Model Averaging by Mallows Criterion

Penalized Time-Varying Model Averaging

A Scalable Frequentist Model Averaging Method

Optimal model averaging for partially linear models with missing response variables and error‐prone covariates

Model Averaging for Generalized Linear Model with Covariates that are Missing completely at Random

On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included

Model averaging estimation for high-dimensional covariance matrices with a network structure

Optimal Model Averaging for Divergent-Dimensional Poisson Regressions

Model Averaging Based on Generalized Method of Moments

INFERENCE AFTER MODEL AVERAGING IN LINEAR REGRESSION MODELS

Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models

Partial Linear Model Averaging Prediction for Longitudinal Data

Model averaging for multivariate multiple regression models

Model Averaging Based on Leave-Subject-out Cross-Validation

Parsimonious Model Averaging With a Diverging Number of Parameters

Stability and L2-penalty in Model Averaging