Abstract:Model selection strategies have been routinely employed to determine a model for data analysis in statistics, and further study and inference then often proceed as though the selected model were the true model that were known a priori. This practice does not account for the uncertainty introduced by the selection process and the fact that the selected model can possibly be a wrong one. Model averaging approaches try to remedy this issue by combining estimators for a set of candidate models. Specifically, instead of deciding which model is the 'right' one, a model averaging approach suggests to fit a set of candidate models and average over the estimators using certain data adaptive weights. In this paper we establish a general frequentist model averaging framework that does not set any restrictions on the set of candidate models. It greatly broadens the scope of the existing methodologies under the frequentist model averaging development. Assuming the data is from an unknown model, we derive the model averaging estimator and study its limiting distributions and related predictions while taking possible modeling biases into account. We propose a set of optimal weights to combine the individual estimators so that the expected mean squared error of the average estimator is minimized. Simulation studies are conducted to compare the performance of the estimator with that of the existing methods. The results show the benefits of the proposed approach over traditional model selection approaches as well as existing model averaging methods.

Model Averaging Based on Generalized Method of Moments

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models

Least Squares Model Averaging Based on Generalized Cross Validation

Model averaging in a multiplicative heteroscedastic model

Model Averaging Based on Leave-Subject-out Cross-Validation

Model Averaging for Generalized Linear Model with Covariates that are Missing completely at Random

Model averaging estimation for generalized partially linear varying-coefficient models

Penalized Time-Varying Model Averaging

Jackknife Model Averaging for Additive Expectile Prediction

Optimal Model Averaging Estimator for Multinomial Logit Models

Jackknife Model Averaging for Mixed-Data Kernel-Weighted Spline Quantile Regressions

A Model Averaging Approach for the Ordered Probit and Nested Logit Models with Applications

Model Averaging for M-estimation

Post-averaging inference for optimal model averaging estimator in generalized linear models

Model averaging for multivariate multiple regression models

A General Framework For Frequentist Model Averaging

MODEL AVERAGING BASED ON KULLBACK-LEIBLER DISTANCE.

Model averaging by jackknife criterion in models with dependent data

A Scalable Frequentist Model Averaging Method

Model Averaging Estimation for Conditional Volatility Models