Abstract:Reliable prediction of traffic accidents is crucial for the identification of potential hazards in advance, formulation of effective preventative measures, and reduction of accident incidence. Existing neural network-based models generally suffer from a limited field of perception and poor long-term dependency capturing abilities, which severely restrict their performance. To address the inherent shortcomings of current traffic prediction models, we propose the Traffic Transformer for multidimensional, multi-step traffic accident prediction. Initially, raw datasets chronicling sporadic traffic accidents are transformed into multivariate, regularly sampled sequences that are amenable to sequential modeling through a temporal discretization process. Subsequently, Traffic Transformer captures and learns the hidden relationships between any elements of the input sequence, constructing accurate prediction for multiple forthcoming intervals of traffic accidents. Our proposed Traffic Transformer employs the sophisticated multi-head attention mechanism in lieu of the widely used recurrent architecture. This significant shift enhances the model's ability to capture long-range dependencies within time series data. Moreover, it facilitates a more flexible and comprehensive learning of diverse hidden patterns within the sequences. It also offers the versatility of convenient extension and transference to other diverse time series forecasting tasks, demonstrating robust potential for further development in this field. Extensive comparative experiments conducted on a real-world dataset from Qatar demonstrate that our proposed Traffic Transformer model significantly outperforms existing mainstream time series forecasting models across all evaluation metrics and forecast horizons. Notably, its Mean Absolute Percentage Error reaches a minimal value of only 4.43%, which is substantially lower than the error rates observed in other models. This remarkable performance underscores the Traffic Transformer's state-of-the-art level of in predictive accuracy.

Short-term freeway traffic speed multistep prediction using an iTransformer model

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

A temporal fusion transformer for short-term freeway traffic speed multistep prediction

Short-Term Forecasting of Traffic Flow and Speed: A Deep Learning Approach

The Conditional Probability of Travel Speed and Its Application to Short-Term Prediction

Spatial–Temporal Deep Tensor Neural Networks for Large-Scale Urban Network Speed Prediction

Random Forests for Freeway Short-Term Traffic Speed Prediction

Traffic flow prediction based on transformer

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction

STTF: An Efficient Transformer Model for Traffic Congestion Prediction

Short-term passenger flow prediction for multi-traffic modes: A Transformer and residual network based multi-task learning method

Transformer network with decoupled spatial–temporal embedding for traffic flow forecasting

Application of Autoformer to Short-Term Traffic Flow Prediction

Passenger Flow Prediction with Transformer : the Shenzhen Metro Case

Intercity Online Car-Hailing Travel Demand Prediction via a Spatiotemporal Transformer Method

A Multi-Layer Model Based on Transformer and Deep Learning for Traffic Flow Prediction

Freeway Short-Term Travel Time Prediction Based on Dynamic Tensor Completion

A Lightweight and Accurate Spatial-Temporal Transformer for Traffic Forecasting

A Short-term Vehicle Speed Prediction Approach considering Dynamic Traffic Scene

Short-Term Travel Speed Prediction for Urban Expressways: Hybrid Convolutional Neural Network Models

A Transferable Intersection Reconstruction Network for Traffic Speed Prediction