Abstract:Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out.

Generating Time Series by Using Latent Space

Enhancing Time Series Forecasting: A Hierarchical Transformer with Probabilistic Decomposition Representation

Latent Diffusion Transformer for Probabilistic Time Series Forecasting

Discovering Predictable Latent Factors for Time Series Forecasting

Itransformer: Inverted Transformers Are Effective for Time Series Forecasting

Two Steps Forward and One Behind: Rethinking Time Series Forecasting with Deep Learning

Learning Latent Seasonal-Trend Representations for Time Series Forecasting

Probabilistic Decomposition Transformer for Time Series Forecasting

Are Transformers Effective for Time Series Forecasting?

Deep Time Series Forecasting Models: A Comprehensive Survey

Leveraging 2D Information for Long-term Time Series Forecasting with Vanilla Transformers

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

Time-Transformer: Integrating Local and Global Features for Better Time Series Generation

A Time Series is Worth 64 Words: Long-term Forecasting with Transformers

NAST: Non-Autoregressive Spatial-Temporal Transformer for Time Series Forecasting

TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variables

TimeLDM: Latent Diffusion Model for Unconditional Time Series Generation

sTransformer: A Modular Approach for Extracting Inter-Sequential and Temporal Information for Time-Series Forecasting

Adversarial Sparse Transformer for Time Series Forecasting

A novel hybrid deep learning time series forecasting model based on long-short-term patterns