Abstract:Reliable prediction of traffic accidents is crucial for the identification of potential hazards in advance, formulation of effective preventative measures, and reduction of accident incidence. Existing neural network-based models generally suffer from a limited field of perception and poor long-term dependency capturing abilities, which severely restrict their performance. To address the inherent shortcomings of current traffic prediction models, we propose the Traffic Transformer for multidimensional, multi-step traffic accident prediction. Initially, raw datasets chronicling sporadic traffic accidents are transformed into multivariate, regularly sampled sequences that are amenable to sequential modeling through a temporal discretization process. Subsequently, Traffic Transformer captures and learns the hidden relationships between any elements of the input sequence, constructing accurate prediction for multiple forthcoming intervals of traffic accidents. Our proposed Traffic Transformer employs the sophisticated multi-head attention mechanism in lieu of the widely used recurrent architecture. This significant shift enhances the model's ability to capture long-range dependencies within time series data. Moreover, it facilitates a more flexible and comprehensive learning of diverse hidden patterns within the sequences. It also offers the versatility of convenient extension and transference to other diverse time series forecasting tasks, demonstrating robust potential for further development in this field. Extensive comparative experiments conducted on a real-world dataset from Qatar demonstrate that our proposed Traffic Transformer model significantly outperforms existing mainstream time series forecasting models across all evaluation metrics and forecast horizons. Notably, its Mean Absolute Percentage Error reaches a minimal value of only 4.43%, which is substantially lower than the error rates observed in other models. This remarkable performance underscores the Traffic Transformer's state-of-the-art level of in predictive accuracy.

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

Spatial–Temporal Deep Tensor Neural Networks for Large-Scale Urban Network Speed Prediction

Short-Term Forecasting of Traffic Flow and Speed: A Deep Learning Approach

Dynamic-learning Spatial-Temporal Transformer Network for Vehicular Trajectory Prediction at Urban Intersections

Short-term freeway traffic speed multistep prediction using an iTransformer model

Learning dynamic and hierarchical traffic spatiotemporal features with Transformer

Traffic flow prediction based on transformer

TrafficPro: A Road Speed Prediction Framework for Urban Signal-Controlled Road Networks

STTF: An Efficient Transformer Model for Traffic Congestion Prediction

Transformer network with decoupled spatial–temporal embedding for traffic flow forecasting

Machine Learning-Based Traffic Flow Prediction and Intelligent Traffic Management

A Multi-Channel Spatial-Temporal Transformer Model for Traffic Flow Forecasting

Short-Term Traffic Flow Prediction Method Based on Spatio-Temporal Characteristics of Complex Road Network

ADCT-Net: Adaptive traffic forecasting neural network via dual-graphic cross-fused transformer

Predictive analytics for traffic flow optimization in urban logistics: A transformer-based time series approach

Graph Spatial-Temporal Transformer Network for Traffic Prediction

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction

Adaptive Spatiotemporal Transformer Graph Network for Traffic Flow Forecasting by IoT Loop Detectors

Passenger Flow Prediction with Transformer : the Shenzhen Metro Case

Boosting Urban Traffic Speed Prediction via Integrating Implicit Spatial Correlations

A Multi-Layer Model Based on Transformer and Deep Learning for Traffic Flow Prediction