Abstract:Long-term series forecasting (LTSF) plays an important role in real-world applications in the economy, the weather, and the industrial process. At present, many transformer-based methods have made promising progress. However, the nature of the permutation-invariant self-attention mechanism inevitably results in temporal information loss, which hinders the prediction performance of the transformer-based LTSF methods. Therefore, this article proposed a novel temporal chain network (TCNet) with an intuitive attention mechanism for LTSF. Based on the chain forward propagation structure of time series, a one-way chain graph neural network (GNN) is constructed to avoid the permutation-invariance of the self-attention mechanism. Meanwhile, based on the natural forgetting mechanism of time series, the prior intuitive attention is proposed as the edge weight (attention) for information propagation and then the series model is obtained by the GNN. Furthermore, the proposed method achieves the LTSF task by linear forecasting of the trend component and nonlinear forecasting of the seasonal component of the series. Extensive experiments on five benchmarks and a real-world chemical process dataset are conducted to demonstrate the effectiveness of the TCNet. Comparison experiment results show that the TCNet achieves state-of-the-art results compared to current baselines and reduces average prediction error by 9.52% and 5.97% on transformer-based and nontransformer-based multivariate LTSF baselines, respectively. Moreover, the temporal information loss for the TCNet due to the permutation-invariance of the self-attention mechanism is not the main reason hindering transformer-based LTSF methods, whose bottleneck comes mainly from the complex architecture of the decoder.

Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecasting

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

SALSTM: Segmented Self-Attention Long Short-Term Memory for Long-Term Forecasting

Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning

Temporal Chain Network with Intuitive Attention Mechanism for Long-Term Series Forecasting.

How Much Can Time-related Features Enhance Time Series Forecasting?

Dynamic Temporal Dependency Model for Multiple Steps Ahead Short-term Load Forecasting of Power System

The Bigger the Better? Rethinking the Effective Model Scale in Long-term Time Series Forecasting

LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters

SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameters

TiVaT: Joint-Axis Attention for Time Series Forecasting with Lead-Lag Dynamics

Introducing Spectral Attention for Long-Range Dependency in Time Series Forecasting

DeformTime: Capturing Variable Dependencies with Deformable Attention for Time Series Forecasting

xLSTMTime : Long-term Time Series Forecasting With xLSTM

A novel attLSTM framework combining the attention mechanism and bidirectional LSTM for demand forecasting

Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distribution

ExoTST: Exogenous-Aware Temporal Sequence Transformer for Time Series Prediction

Adaptive Multi-Scale Decomposition Framework for Time Series Forecasting

UniTST: Effectively Modeling Inter-Series and Intra-Series Dependencies for Multivariate Time Series Forecasting

Physically-guided Temporal Diffusion Transformer for Long-Term Time Series Forecasting

Are Transformers Effective for Time Series Forecasting?