Abstract:We provide contingent empirical evidence on the solutions to three problems associated with univariate time series forecasting using machine learning (ML) algorithms by conducting an extensive multiple-case study. These problems are: (a) lagged variable selection, (b) hyperparameter handling, and (c) comparison between ML and classical algorithms. The multiple-case study is composed by 50 single-case studies, which use time series of mean monthly temperature and total monthly precipitation observed in Greece. We focus on two ML algorithms, i.e. neural networks and support vector machines, while we also include four classical algorithms and a naïve benchmark in the comparisons. We apply a fixed methodology to each individual case and, subsequently, we perform a cross-case synthesis to facilitate the detection of systematic patterns. We fit the models to the deseasonalized time series. We compare the one- and multi-step ahead forecasting performance of the algorithms. Regarding the one-step ahead forecasting performance, the assessment is based on the absolute error of the forecast of the last monthly observation. For the quantification of the multi-step ahead forecasting performance we compute five metrics on the test set (last year’s monthly observations), i.e. the root mean square error, the Nash-Sutcliffe efficiency, the ratio of standard deviations, the coefficient of correlation and the index of agreement. The evidence derived by the experiments can be summarized as follows: (a) the results mostly favour using less recent lagged variables, (b) hyperparameter optimization does not necessarily lead to better forecasts, (c) the ML and classical algorithms seem to be equally competitive.

A Study of the Effect of Data Transformation and «Linearization» on Time Series Forecasts. A Practical Approach

Macroeconomic Data Transformations Matter

Interval Time Series Forecasting: An Innovative Approach Transforming Interval to Single Time Series

Interval Time Series Analysis with an Application to the Sterling-Dollar Exchange Rate

Forecasting economic growth by combining local linear and standard approaches

Nonlinear dynamics in economics and finance and unit root testing

Transformed-Linear Innovations Algorithm for Modeling and Forecasting of Time Series Extremes

Forecasting economic time series using flexible versus fixed specification and linear versus nonlinear econometric models

EFFECT OF LINEAR DATA PROCESSING PROCESSES ON THE PREDICTION PERFORMANCE OF THE NEURAL NETWORK: AN APPLICATION WITH EXCHANGE RATE DATA

A Multi-Method Survey on the Use of Sentiment Analysis in Multivariate Financial Time Series Forecasting

An Analysis of Linear Time Series Forecasting Models

Univariate Time Series Forecasting of Temperature and Precipitation with a Focus on Machine Learning Algorithms: a Multiple-Case Study from Greece

Forecasting economic and financial time-series with non-linear models

Real-time Inflation Forecasting Using Non-linear Dimension Reduction Techniques

High-Dimensional Forecasting in the Presence of Unit Roots and Cointegration

Merging Structural and Reduced-Form Models for Forecasting

Autoregressive approaches to import--export time series II: a concrete case study

Trade and Economic Activity: Nonlinear Modeling and Forecasting

A New Look at Cross-Country Aggregation in the Global VAR Approach: Theory and Monte Carlo Simulation

Modelling Returns and Volatilities During Financial Crises: a Time Varying Coefficient Approach

Data transformation: a focus on the interpretation