Abstract:We consider forecasting a single time series when there is a large number of predictors and a possible nonlinear effect. The dimensionality was first reduced via a high-dimensional (approximate) factor model implemented by the principal component analysis. Using the extracted factors, we develop a novel forecasting method called the sufficient forecasting, which provides a set of sufficient predictive indices, inferred from high-dimensional predictors, to deliver additional predictive power. The projected principal component analysis will be employed to enhance the accuracy of inferred factors when a semi-parametric (approximate) factor model is assumed. Our method is also applicable to cross-sectional sufficient regression using extracted factors. The connection between the sufficient forecasting and the deep learning architecture is explicitly stated. The sufficient forecasting correctly estimates projection indices of the underlying factors even in the presence of a nonparametric forecasting function. The proposed method extends the sufficient dimension reduction to high-dimensional regimes by condensing the cross-sectional information through factor models. We derive asymptotic properties for the estimate of the central subspace spanned by these projection directions as well as the estimates of the sufficient predictive indices. We further show that the natural method of running multiple regression of target on estimated factors yields a linear estimate that actually falls into this central subspace. Our method and theory allow the number of predictors to be larger than the number of observations. We finally demonstrate that the sufficient forecasting improves upon the linear forecasting in both simulation studies and an empirical study of forecasting macroeconomic variables.

A Dynamic Factor Machine Learning Method for Multi-variate and Multi-step-Ahead Forecasting

Batch and incremental dynamic factor machine learning for multivariate and multi-step-ahead forecasting

Foreformer: an Enhanced Transformer-Based Framework for Multivariate Time Series Forecasting

Forecasting in data-rich environments

DAFT-E: Feature-Based Multivariate and Multi-Step-Ahead Wind Power Forecasting

Masked Multi-Step Multivariate Time Series Forecasting with Future Information

Time-Series Classification for Dynamic Strategies in Multi-Step Forecasting

FDF: Flexible Decoupled Framework for Time Series Forecasting with Conditional Denoising and Polynomial Modeling

Deep Factors with Gaussian Processes for Forecasting

DEFM: Delay E mbedding based Forecast Machine for Time Series Forecasting by Spatiotemporal Information Transformation

Deep Functional Factor Models: Forecasting High-Dimensional Functional Time Series via Bayesian Nonparametric Factorization

Sufficient Forecasting Using Factor Models

DMIDAS: Deep Mixed Data Sampling Regression for Long Multi-Horizon Time Series Forecasting

Machine learning applications in time series hierarchical forecasting

Multi-output Ensembles for Multi-step Forecasting

A Forecast-driven Hierarchical Factor Model with Application to Mortality Data

A hybrid framework for multivariate long-sequence time series forecasting

DMDP: A Dynamic Multi-source Default Probability Prediction Framework.

Statistical, machine learning and deep learning forecasting methods: Comparisons and ways forward