Abstract:In agricultural research, it is often difficult to construct a single "best" predictive model based on data collected under field conditions. We studied the relative prediction performance of combining empirical linear models over the single best model in relation to number of models to be combined, number of variates in the models, magnitude of residual errors, and weighting schemes. Two scenarios were simulated: the modeler did or did not know the relative of performance of the models to be combined. For the former case, model averaging is achieved either through weights based on the Akaike Information Criterion (AIC) statistic or with arithmetic averaging; for the latter case, only the arithmetic averaging is possible (because the relative model predictive performance is not known for a common dataset). In addition to two experimental datasets on oat mycotoxins in relation to environmental variables, two datasets were generated assuming a consistent correlation structure among explanatory variates with two magnitudes of residual errors. For the majority of cases, model averaging resulted in improved prediction performance over the single-model predictions, especially when a modeler does not have the information of relative model performance. The fewer variates in the models to be combined, the greater is improvement of model averaging over the single-model predictions. Combining models led to very little improvement over individual models when there were many variates in individual models. Overall, simple arithmetic averaging resulted in slightly better performance than the AIC-based weighted averaging. The advantage in model averaging is also noticeable for larger residual errors. This study suggests that model averaging generally performs better than single-model predictions, especially when a modeler does not have information on the relative performance of the candidate models.

Prediction Using Many Samples with Models Possibly Containing Partially Shared Parameters

Model Averaging for Prediction with Fragmentary Data

Jackknife Model Averaging for Additive Expectile Prediction

Partial Linear Model Averaging Prediction for Longitudinal Data

Least Squares Model Averaging by Prediction Criterion (job Market Paper)

Model averaging prediction by K -fold cross-validation

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Penalized Time-Varying Model Averaging

AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories

Model Averaging by Cross-validation for Partially Linear Functional Additive Models

Multifold Cross-Validation Model Averaging for Generalized Additive Partial Linear Models

Model averaging prediction for time series models with a diverging number of parameters

Semiparametric Model Average Prediction in Panel Data Analysis

Optimal Parameter-Transfer Learning by Semiparametric Model Averaging

A Scalable Frequentist Model Averaging Method

Parsimonious Model Averaging With a Diverging Number of Parameters

Dynamic Latent Class Model Averaging for Online Prediction

Combining Models is More Likely to Give Better Predictions Than Single Models.

Model Averaging with Privacy-Preserving.

Prediction Model Averaging Estimator

Model averaging in a multiplicative heteroscedastic model