Abstract:Accurate traffic forecasting is a fundamental problem in intelligent transportation systems and learning long-range traffic representations with key information through spatiotemporal graph neural networks (STGNNs) is a basic assumption of current traffic flow prediction models. However, due to structural limitations, existing STGNNs can only utilize short-range traffic flow data; therefore, the models cannot adequately learn the complex trends and periodic features in traffic flow. Besides, it is challenging to extract the key temporal information from the long historical traffic series and obtain a compact representation. To solve the above problems, we propose a novel LSTTN (Long-Short Term Transformer-based Network) framework comprehensively considering the long- and short-term features in historical traffic flow. First, we employ a masked subseries Transformer to infer the content of masked subseries from a small portion of unmasked subseries and their temporal context in a pretraining manner, forcing the model to efficiently learn compressed and contextual subseries temporal representations from long historical series. Then, based on the learned representations, long-term trend is extracted by using stacked 1D dilated convolution layers, and periodic features are extracted by dynamic graph convolution layers. For the difficulties in making time-step level prediction, LSTTN adopts a short-term trend extractor to learn fine-grained short-term temporal features. Finally, LSTTN fuses the long-term trend, periodic features and short-term features to obtain the prediction results. Experiments on four real-world datasets show that in 60-minute-ahead long-term forecasting, the LSTTN model achieves a minimum improvement of 5.63\% and a maximum improvement of 16.78\% over baseline models. The source code is available at

A Bagging Long Short-term Memory Network for Financial Transmission Rights Forecasting

Combining fuzzy clustering and improved long short-term memory neural networks for short-term load forecasting

Short-term Load Forecasting Using a Long Short-Term Memory Network.

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

Short-term load forecasting based on LSTM networks considering attention mechanism

Residual long short-term memory network with multi-source and multi-frequency information fusion: An application to China?s stock market

Attention Mechanism Multi-size Depthwise Convolutional Long Short-term Memory Neural Network for Forecasting Real-time Electricity Prices

Residual long short-term memory network with multi-source and multi-frequency information fusion: An application to China's stock market

Electricity Load Forecasting for Distribution Network Based on Long Short-term Memory Recurrent Neural Network

LSTTN: A Long-Short Term Transformer-based Spatio-temporal Neural Network for Traffic Flow Forecasting

LSTTN: A Long-Short Term Transformer-based spatiotemporal neural network for traffic flow forecasting

Ultra short term power load forecasting based on the fusion of Seq2Seq BiLSTM and multi head attention mechanism

Advanced Short-Term Load Forecasting with XGBoost-RF Feature Selection and CNN-GRU

Multi-Step Ahead Short-Term Load Forecasting Using Hybrid Feature Selection and Improved Long Short-Term Memory Network

TCLN: A Transformer-based Conv-LSTM Network for Multivariate Time Series Forecasting

A Holistic Feature Selection Method for Enhanced Short-Term Load Forecasting of Power System

FL-Net: A multi-scale cross-decomposition network with frequency external attention for long-term time series forecasting

Model-driven multimodal LSTM-CNN for unbiased structural forecasting of European Union allowances open-high-low-close price

Enhanced LFTSformer: A Novel Long-Term Financial Time Series Prediction Model Using Advanced Feature Engineering and the DS Encoder Informer Architecture

Adaptive Bi-Directional LSTM Short-Term Load Forecasting with Improved Attention Mechanisms

Research on Short-term Time Series Forecasting Method Based on Feature Fusion of Electric Power