Abstract:Seasonal–trend-decomposed transformer has empowered long-term time series forecasting via capturing global temporal dependencies (e.g., period-based dependencies) in disentangled temporal patterns. However, existing methods design various auto-correlation or attention mechanisms in the seasonal view while ignoring the fine-grained temporal patterns in the trend view in the series decomposition component, which causes an information utilization bottleneck. To this end, a Transformer-based seasonal–trend decomposition methodology with a multi-scale attention mechanism in the trend view and a multi-view attention mechanism in the seasonal view is proposed, called DESTformer. Specifically, rather than utilizing the moving average operation in obtaining trend data, a frequency domain transform is first applied to extract seasonal (high-frequency) and trend (low-frequency) components, explicitly capturing different temporal patterns in both seasonal and trend views. For the trend component, a multi-scale attention mechanism is designed to capture fine-grained sub-trends under different receptive fields. For the seasonal component, instead of the frequency-only attention mechanism, a multi-view frequency domain (i.e., frequency, amplitude, and phase) attention mechanism is designed to enhance the ability to capture the complex periodic changes. Extensive experiments are conducted on six benchmark datasets covering five practical applications: energy, transportation, economics, weather, and disease. Compared to the state-of-the-art FEDformer, our model shows reduced MSE and MAE by averages of 6.5% and 3.7%, respectively. Such experimental results verify the effectiveness of our method and point out a new way towards handling trends and seasonal patterns in long-term time series forecasting tasks.

A Decomposition Modeling Framework for Seasonal Time-Series Forecasting

Two-Stage Framework for Seasonal Time Series Forecasting

A Robust and Efficient Multi-Scale Seasonal-Trend Decomposition

Adaptive Multi-Scale Decomposition Framework for Time Series Forecasting

Multivariate Time Series Forecasting based on Time-Frequency Decomposition

A Novel Time Series Forecasting Approach with Multi-Level Data Decomposing and Modeling

NTDformer: A Multi-Scale Forecasting Model for Non-Stationary Multilevel Time Series

Multivariate Time Series Modeling and Forecasting with Parallelized Convolution and Decomposed Sparse-Transformer

MSTL: A Seasonal-Trend Decomposition Algorithm for Time Series with Multiple Seasonal Patterns

Breaking the Context Bottleneck on Long Time Series Forecasting

Multivariate Segment Expandable Encoder-Decoder Model for Time Series Forecasting

Multi-Layer Seasonal Perception Network for Time Series Forecasting

Time Series Forecasting with Multi-scale Decomposition and Fourier Neural Operators

TimeMixer: Decomposable Multiscale Mixing for Time Series Forecasting

Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modeling

DESTformer: A Transformer Based on Explicit Seasonal–Trend Decomposition for Long-Term Series Forecasting

FDF: Flexible Decoupled Framework for Time Series Forecasting with Conditional Denoising and Polynomial Modeling

A decomposition-guided mechanism for nonstationary time series forecasting

Disentangling Structured Components: Towards Adaptive, Interpretable and Scalable Time Series Forecasting

TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting