ASSTFormer: Adaptive Sparse Spatial-Temporal Transformer for Effective Traffic Forecasting

Ruifeng Liang,Zhiheng Li,Kai Zhang
DOI: https://doi.org/10.1109/ainit61980.2024.10581738
2024-01-01
Abstract:Traffic prediction is of crucial importance for Intelligent Transportation System (ITS). The primary challenge lies in accurately capturing the intricate spatial-temporal traffic flows. In recent years, many researchers have employed graph-based research methods in an attempt to address this crucial issue. However, two major limitations have impacted their predictive performance. Firstly, many graph-based models utilize predefined graph structures based on static geographical information, which limits the capacity to accurately represent the genuine spatiotemporal features of the data. Moreover, these models' local perception restricts their ability to consider global spatial dependency. Therefore, we present ASSTFormer, an Adaptive §.parse §.patial- Iemporal transFormer-based model to overcome these limitations. Specifically, we propose an adaptive embedding method to capture dynamic patterns and regularities of traffic flow changes. We then design a transformer-style module to catch dynamic spatial-temporal dependencies, introducing a learnable sparse spatial attention to simulate realistic spatial interactions. Furthermore, we adopt a multi-head mechanism to integrate heterogeneous attention results and employ a generative decoder to predict multiple timestamps in a single forward pass. Extensive experiments on three widely used traffic benchmarks demonstrate that our model outperforms existing methods.
What problem does this paper attempt to address?