Abstract:Hierarchical forecasting techniques allow for the creation of forecasts that are coherent with respect to a pre-specified hierarchy of the underlying time series. This targets a key problem in e-commerce, where we often find millions of products across many product hierarchies, and forecasts must be made for individual products and product aggregations. However, existing hierarchical forecasting techniques scale poorly when the number of time series increases, which limits their applicability at a scale of millions of products. In this paper, we propose to learn a coherent forecast for millions of products with a single bottom-level forecast model by using a loss function that directly optimizes the hierarchical product structure. We implement our loss function using sparse linear algebra, such that the number of operations in our loss function scales quadratically rather than cubically with the number of products and levels in the hierarchical structure. The benefit of our sparse hierarchical loss function is that it provides practitioners with a method of producing bottom-level forecasts that are coherent to any chosen cross-sectional or temporal hierarchy. In addition, removing the need for a post-processing step as required in traditional hierarchical forecasting techniques reduces the computational cost of the prediction phase in the forecasting pipeline and its deployment complexity. In our tests on the public M5 dataset, our sparse hierarchical loss function performs up to 10% better as measured by RMSE and MAE than the baseline loss function. Next, we implement our sparse hierarchical loss function within a gradient boosting-based forecasting model at bol.com, a large European e-commerce platform. At bol.com, each day, a forecast for the weekly demand of every product for the next twelve weeks is required. In this setting, our sparse hierarchical loss resulted in an improved forecasting performance as measured by RMSE of about 2% at the product level, compared to the baseline model, and an improvement of about 10% at the product level as measured by MAE. Finally, we found an increase in forecasting performance of about 5%–10% (both RMSE and MAE) when evaluating the forecasting performance across the cross-sectional hierarchies we defined. These results demonstrate the usefulness of our sparse hierarchical loss applied to a production forecasting system at a major e-commerce platform.

Blending gradient boosted trees and neural networks for point and probabilistic forecasting of hierarchical time series

Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approach

A machine learning approach for forecasting hierarchical time series

An adaptive volatility method for probabilistic forecasting and its application to the M6 financial forecasting competition

Hierarchical forecasting with a top-down alignment of independent level forecasts

Optimizing accuracy and diversity: a multi-task approach to forecast combinations

N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting

A novel probabilistic gradient boosting model with multi-approach feature selection and iterative seasonal trend decomposition for short-term load forecasting

Robust Multivariate Time Series Forecasting against Intra- and Inter-Series Transitional Shift

Multivariate Boosted Trees and Applications to Forecasting and Control

A Bayesian Model for Forecasting Hierarchically Structured Time Series

Forecasting with Hyper-Trees

Simultaneously Reconciled Quantile Forecasting of Hierarchically Related Time Series

Probabilistic hierarchical forecasting with deep Poisson mixtures

Hierarchically Coherent Multivariate Mixture Networks

Machine learning applications in time series hierarchical forecasting

Hierarchical forecasting at scale

Hierarchical Time Series Forecasting with Bayesian Modeling

SLOTH: Structured Learning and Task-Based Optimization for Time Series Forecasting on Hierarchies

Probabilistic Hierarchical Interpolation and Interpretable Configuration for Flood Prediction