Abstract:Reliable prediction of traffic accidents is crucial for the identification of potential hazards in advance, formulation of effective preventative measures, and reduction of accident incidence. Existing neural network-based models generally suffer from a limited field of perception and poor long-term dependency capturing abilities, which severely restrict their performance. To address the inherent shortcomings of current traffic prediction models, we propose the Traffic Transformer for multidimensional, multi-step traffic accident prediction. Initially, raw datasets chronicling sporadic traffic accidents are transformed into multivariate, regularly sampled sequences that are amenable to sequential modeling through a temporal discretization process. Subsequently, Traffic Transformer captures and learns the hidden relationships between any elements of the input sequence, constructing accurate prediction for multiple forthcoming intervals of traffic accidents. Our proposed Traffic Transformer employs the sophisticated multi-head attention mechanism in lieu of the widely used recurrent architecture. This significant shift enhances the model's ability to capture long-range dependencies within time series data. Moreover, it facilitates a more flexible and comprehensive learning of diverse hidden patterns within the sequences. It also offers the versatility of convenient extension and transference to other diverse time series forecasting tasks, demonstrating robust potential for further development in this field. Extensive comparative experiments conducted on a real-world dataset from Qatar demonstrate that our proposed Traffic Transformer model significantly outperforms existing mainstream time series forecasting models across all evaluation metrics and forecast horizons. Notably, its Mean Absolute Percentage Error reaches a minimal value of only 4.43%, which is substantially lower than the error rates observed in other models. This remarkable performance underscores the Traffic Transformer's state-of-the-art level of in predictive accuracy.

A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networks

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

Spatial-Temporal Graph Attention Gated Recurrent Transformer Network for Traffic Flow Forecasting

Learning dynamic and hierarchical traffic spatiotemporal features with Transformer

Spatial–Temporal Transformer Networks for Traffic Flow Forecasting Using a Pre-Trained Language Model

Adaptive Graph Spatial-Temporal Transformer Network for Traffic Flow Forecasting

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction

A spatial‐temporal graph gated transformer for traffic forecasting

A Multi-Layer Model Based on Transformer and Deep Learning for Traffic Flow Prediction

Spatial-Temporal Multi-Head Attention Networks for Traffic Flow Forecasting.

A Multi-Channel Spatial-Temporal Transformer Model for Traffic Flow Forecasting

Spatio-Temporal Parallel Transformer based model for Traffic Prediction

Graph Transformer Attention Networks for Traffic Flow Prediction

A Multi-view Spatial-temporal Adaptive Transformer-GRU Framework for Traffic Flow Prediction

Traffic Flow Forecasting Based on Transformer with Diffusion Graph Attention Network

Attention-based spatial-temporal graph transformer for traffic flow forecasting

EGFormer: An Enhanced Transformer Model with Efficient Attention Mechanism for Traffic Flow Forecasting

Graph transformer based dynamic multiple graph convolution networks for traffic flow forecasting

Traffic transformer: Capturing the continuity and periodicity of time series for traffic forecasting

Multi-scale spatial-temporal aware transformer for traffic prediction

Transformer-based Spatio-Temporal Traffic Prediction for Access and Metro Networks