Abstract:Whether deterministic or stochastic, models can be viewed as functions designed to approximate a specific quantity of interest. We propose a data-driven framework that aggregates predictions from diverse models into a single, more accurate output. This aggregation approach exploits each model's strengths to enhance overall accuracy. It is non-intrusive - treating models as black-box functions - model-agnostic, requires minimal assumptions, and can combine outputs from a wide range of models, including those from machine learning and numerical solvers. We argue that the aggregation process should be point-wise linear and propose two methods to find an optimal aggregate: Minimal Error Aggregation (MEA), which minimizes the aggregate's prediction error, and Minimal Variance Aggregation (MVA), which minimizes its variance. While MEA is inherently more accurate when correlations between models and the target quantity are perfectly known, Minimal Empirical Variance Aggregation (MEVA), an empirical version of MVA - consistently outperforms Minimal Empirical Error Aggregation (MEEA), the empirical counterpart of MEA, when these correlations must be estimated from data. The key difference is that MEVA constructs an aggregate by estimating model errors, while MEEA treats the models as features for direct interpolation of the quantity of interest. This makes MEEA more susceptible to overfitting and poor generalization, where the aggregate may underperform individual models during testing. We demonstrate the versatility and effectiveness of our framework in various applications, such as data science and partial differential equations, showing how it successfully integrates traditional solvers with machine learning models to improve both robustness and accuracy.

Measuring the advantages of contemporaneous aggregation in forecasting

To aggregate or not to aggregate: Forecasting of finite autocorrelated demand

Automatic Forecasting Agent for e-Commerce Applications

Temporal Aggregation of Markov-switching Financial Return Models

Forecasting Vector Autoregressions with Mixed Roots in the Vicinity of Unity

Modeling of forecasts variance reduction at multiple time series prediction averaging with ARMA (1, q) functions

Temporal aggregation of equity return time-series models

Intermittent Demand Forecasting and Inventory Control with Multiple Temporal and Cross-sectional Aggregation and Disaggregation Methods

Algorithmic Robust Forecast Aggregation

The Surprising Benefits of Base Rate Neglect in Robust Aggregation

Forecasting Cointegrated Nonstationary Time Series with Time-Varying Variance

Dynamic partial (co)variance forecasting model

A New Look at Cross-Country Aggregation in the Global VAR Approach: Theory and Monte Carlo Simulation

Model aggregation: minimizing empirical variance outperforms minimizing empirical error

Expert Aggregation for Financial Forecasting

The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecasting

Risk measurement of aggregation approaches in multiple attribute decision making under uncertain information

Enhancing Multivariate Time Series Forecasting with Mutual Information-driven Cross-Variable and Temporal Modeling

Forecasting with Bayesian vector autoregressive models: comparison of direct and iterated multistep methods

Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation

To Combine Forecasts or to Combine Information?