Abstract:Traffic prediction is one of the fundamental spatio-temporal prediction tasks in urban computing, which is of great significance to a wide range of applications, e.g., traffic controlling, vehicle scheduling, etc. Recently, with the expansion of the city and the development of public transportation, long-range and long-term spatio-temporal correlations play a more important role in traffic prediction. However, it is challenging to model long-range spatial dependencies and long-term temporal dependencies simultaneously in two aspects: 1) complex influential factors, including spatial, temporal and external factors. 2) multiple spatio-temporal correlations, including long-range and short-range spatial correlations, as well as long-term and short-term temporal correlations. To solve these issues, we propose a spatio-temporal memory augmented multi-level attention network for fine-grained traffic prediction, entitled ST-MAN. Specifically, we design a spatio-temporal memory network to encode and memorize fine-grained spatial information and representative temporal patterns. Then, we propose a multi-level attention network to explicitly model both short-term local spatio-temporal dependencies and long-term global spatio-temporal dependencies at different spatial scales (i.e., grid and region levels) and temporal scales (i.e., daily and weekly levels). In addition, we design an external component that takes external factors and spatial embeddings as inputs to generate location-aware influence of the external factors much more efficiently. Finally, we design an end-to-end framework optimized with the contrastive objective and supervised objective to boost model performance. Empirical experiments over coarse-grained and fine-grained real-world datasets demonstrate the superiority of the ST-MAN model compared to several state-of-the-art baselines.

Spatiotemporal Data Prediction Model Based on a Multi-Layer Attention Mechanism

Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning

Enhancing spatiotemporal predictive learning: an approach with nested attention module

GeoMAN: Multi-level Attention Networks for Geo-sensory Time Series Prediction

Spatio-Temporal Memory Augmented Multi-Level Attention Network for Traffic Prediction

Spatiotemporal Attention for Multivariate Time Series Prediction and Interpretation

HSTA: A Hierarchical Spatio-Temporal Attention Model for Trajectory Prediction

A spatiotemporal hierarchical attention mechanism-based model for multi-step station-level crowd flow prediction

STJLA: A Multi-Context Aware Spatio-Temporal Joint Linear Attention Network for Traffic Forecasting

Spatial–temporal combination and multi-head flow-attention network for traffic flow prediction

Future locations prediction with multi-graph attention networks based on spatial–temporal LSTM framework

Dual Memory LSTM with Dual Attention Neural Network for Spatiotemporal Prediction

A Spatial–Temporal Attention Approach for Traffic Prediction

Traffic Prediction Model Based on Spatio-temporal Graph Attention Network

Multicomponent Spatial-Temporal Graph Attention Convolution Networks for Traffic Prediction with Spatially Sparse Data

Pedestrian trajectory prediction based on spatio-temporal attention mechanism

Road traffic flow prediction based on dynamic spatiotemporal graph attention network

Multiplicative Attention Mechanism for Multi-horizon Time Series Forecasting

Attention-based multi-scale prediction network for time-series data

Spatio-Temporal Traffic Flow Prediction Based on Coordinated Attention

Triplet Attention Transformer for Spatiotemporal Predictive Learning