Abstract:Accurate traffic forecasting is a fundamental problem in intelligent transportation systems and learning long-range traffic representations with key information through spatiotemporal graph neural networks (STGNNs) is a basic assumption of current traffic flow prediction models. However, due to structural limitations, existing STGNNs can only utilize short-range traffic flow data; therefore, the models cannot adequately learn the complex trends and periodic features in traffic flow. Besides, it is challenging to extract the key temporal information from the long historical traffic series and obtain a compact representation. To solve the above problems, we propose a novel LSTTN (Long-Short Term Transformer-based Network) framework comprehensively considering the long- and short-term features in historical traffic flow. First, we employ a masked subseries Transformer to infer the content of masked subseries from a small portion of unmasked subseries and their temporal context in a pretraining manner, forcing the model to efficiently learn compressed and contextual subseries temporal representations from long historical series. Then, based on the learned representations, long-term trend is extracted by using stacked 1D dilated convolution layers, and periodic features are extracted by dynamic graph convolution layers. For the difficulties in making time-step level prediction, LSTTN adopts a short-term trend extractor to learn fine-grained short-term temporal features. Finally, LSTTN fuses the long-term trend, periodic features and short-term features to obtain the prediction results. Experiments on four real-world datasets show that in 60-minute-ahead long-term forecasting, the LSTTN model achieves a minimum improvement of 5.63\% and a maximum improvement of 16.78\% over baseline models. The source code is available at

FL-Net: A multi-scale cross-decomposition network with frequency external attention for long-term time series forecasting

Foreformer: an Enhanced Transformer-Based Framework for Multivariate Time Series Forecasting

Hidformer: Hierarchical Dual-Tower Transformer Using Multi-Scale Mergence for Long-Term Time Series Forecasting

CrossWaveNet: A dual-channel network with deep cross-decomposition for Long-term Time Series Forecasting

Temporal Chain Network with Intuitive Attention Mechanism for Long-Term Series Forecasting.

FDNet: Focal Decomposed Network for Efficient, Robust and Practical Time Series Forecasting

W-FENet: Wavelet-based Fourier-Enhanced Network Model Decomposition for Multivariate Long-Term Time-Series Forecasting

GLFNet: Global and Local Frequency-domain Network for Long-term Time Series Forecasting

TFDNet: Time-Frequency Enhanced Decomposed Network for Long-term Time Series Forecasting

MMFNet: Multi-Scale Frequency Masking Neural Network for Multivariate Time Series Forecasting

Long Time Series Deep Forecasting with Multiscale Feature Extraction and Seq2seq Attention Mechanism

TLNets: Transformation Learning Networks for long-range time-series prediction

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distribution

MFF-FTNet: Multi-scale Feature Fusion across Frequency and Temporal Domains for Time Series Forecasting

DRFormer: Multi-Scale Transformer Utilizing Diverse Receptive Fields for Long Time-Series Forecasting

Time Series Forecasting with Multi-scale Decomposition and Fourier Neural Operators

Segmented Frequency‐Domain Correlation Prediction Model for Long‐Term Time Series Forecasting Using Transformer

Expanding the Prediction Capacity in Long Sequence Time-Series Forecasting

Periodformer: an Efficient Long-Term Time Series Forecasting Method Based on Periodic Attention

LSTTN: A Long-Short Term Transformer-based Spatio-temporal Neural Network for Traffic Flow Forecasting