STA-former: encoding traffic flows with spatio-temporal associations in transformer networks for prediction

Hui Zeng,Xuewei Duan,Xiaohui Huang,Qiang Cui
DOI: https://doi.org/10.1007/s10586-024-04462-y
2024-04-28
Cluster Computing
Abstract:Modern transportation networks exhibit intricate dynamic characteristics and diverse correlations, making the construction of an efficient traffic prediction system quite challenging. Current prediction frameworks typically rely on the physical distance or connectivity between nodes to construct a relationship matrix, yet they fail to fully explore the potential spatial dependency. Additionally, most methods encounter difficulties in addressing the complex internal coupling of spatial heterogeneity and temporal correlation, as well as dynamic relationships. We propose an innovative traffic flow prediction framework STA-Former, designed to accurately handle traffic flow information. The core of this framework consists of two dynamically generated mask matrices driven by data, enhancing the model's ability to uncover potential spatial dependencies and better address the interaction between spatial heterogeneity and temporal correlation. We have revamped the classical Transformer architecture with secondary encoding, significantly improving learning efficiency. Experimental results demonstrate that our proposed outperforms baseline models in terms of performance.
computer science, information systems, theory & methods
What problem does this paper attempt to address?