Abstract:Forecast combination has been proven to be a very important technique to obtain accurate predictions for various applications in economics, finance, marketing and many other areas. In many applications, forecast errors exhibit heavy-tailed behaviors for various reasons. Unfortunately, to our knowledge, little has been done to obtain reliable forecast combinations for such situations. The familiar forecast combination methods, such as simple average, least squares regression or those based on the variance-covariance of the forecasts, may perform very poorly due to the fact that outliers tend to occur, and they make these methods have unstable weights, leading to un-robust forecasts. To address this problem, in this paper, we propose two nonparametric forecast combination methods. One is specially proposed for the situations in which the forecast errors are strongly believed to have heavy tails that can be modeled by a scaled Student’s t-distribution; the other is designed for relatively more general situations when there is a lack of strong or consistent evidence on the tail behaviors of the forecast errors due to a shortage of data and/or an evolving data-generating process. Adaptive risk bounds of both methods are developed. They show that the resulting combined forecasts yield near optimal mean forecast errors relative to the candidate forecasts. Simulations and a real example demonstrate their superior performance in that they indeed tend to have significantly smaller prediction errors than the previous combination methods in the presence of forecast outliers.

Learning from batched data: Model combination os-data combination

Learning from Batched Data: Model Combination Versus Data Combination

Model Combination In The Multiple-Data-Batches Scenario

Theory Combination: an alternative to Data Combination by Kai Ming Ting, Boon Tob Low

Theory Combination: an alternative to Data Combination

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Batch Process Modeling with Few-Shot Learning

Sequential Combination Methods for Data Clustering Analysis

Non-intrusive model combination for learning dynamical systems

Using Correspondence Analysis to Combine Classifiers

Efficient Online Data Mixing For Language Model Pre-Training

Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance

Decision Combination Based on the Characterisation of Predictive Accuracy.

A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluation

Big Learning Expectation Maximization

Batch process modeling based on process similarity

A Double Machine Learning Approach to Combining Experimental and Observational Data

Optimal Linear Combination Using Decision Reliability Of Individual Classifiers

Classifier Combination Based on Active Learning

Learn to Combine Modalities in Multimodal Deep Learning

Forecast Combination under Heavy-Tailed Errors