Abstract:Reliable prediction of traffic accidents is crucial for the identification of potential hazards in advance, formulation of effective preventative measures, and reduction of accident incidence. Existing neural network-based models generally suffer from a limited field of perception and poor long-term dependency capturing abilities, which severely restrict their performance. To address the inherent shortcomings of current traffic prediction models, we propose the Traffic Transformer for multidimensional, multi-step traffic accident prediction. Initially, raw datasets chronicling sporadic traffic accidents are transformed into multivariate, regularly sampled sequences that are amenable to sequential modeling through a temporal discretization process. Subsequently, Traffic Transformer captures and learns the hidden relationships between any elements of the input sequence, constructing accurate prediction for multiple forthcoming intervals of traffic accidents. Our proposed Traffic Transformer employs the sophisticated multi-head attention mechanism in lieu of the widely used recurrent architecture. This significant shift enhances the model's ability to capture long-range dependencies within time series data. Moreover, it facilitates a more flexible and comprehensive learning of diverse hidden patterns within the sequences. It also offers the versatility of convenient extension and transference to other diverse time series forecasting tasks, demonstrating robust potential for further development in this field. Extensive comparative experiments conducted on a real-world dataset from Qatar demonstrate that our proposed Traffic Transformer model significantly outperforms existing mainstream time series forecasting models across all evaluation metrics and forecast horizons. Notably, its Mean Absolute Percentage Error reaches a minimal value of only 4.43%, which is substantially lower than the error rates observed in other models. This remarkable performance underscores the Traffic Transformer's state-of-the-art level of in predictive accuracy.

inTformer: A Time-Embedded Attention-Based Transformer for Crash Likelihood Prediction at Intersections Using Connected Vehicle Data

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

Dynamic-learning Spatial-Temporal Transformer Network for Vehicular Trajectory Prediction at Urban Intersections

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction

An advanced real-time crash prediction framework for combined hard shoulder running and variable speed limits system using transformer

Real-Time Crash Risk Prediction using Long Short-Term Memory Recurrent Neural Network

Dual-Transformer: A General Model for Traffic Accident Prediction

An Automated Approach for Predicting Road Traffic Accident Severity Using Transformer Learning and Explainable AI Technique

Dynamic inferences of crash risks in freeway merging zones: a spatio-temporal deep learning model

Intention-Aware Interactive Transformer for Real-Time Vehicle Trajectory Prediction in Dense Traffic

Short-term freeway traffic speed multistep prediction using an iTransformer model

Real-time crash prediction on express managed lanes of Interstate highway with anomaly detection learning

Transformer based composite network for autonomous driving trajectory prediction on multi-lane highways

Predicting pedestrian-vehicle interaction severity at unsignalized intersections

MSCT: Addressing Time-Varying Confounding with Marginal Structural Causal Transformer for Counterfactual Post-Crash Traffic Prediction

Vehicle Trajectory Prediction Based on Intention-Aware Non-Autoregressive Transformer With Multi-Attention Learning for Internet of Vehicles

STTF: An Efficient Transformer Model for Traffic Congestion Prediction

Traffic Safety Oriented Multi-Intersection Flow Prediction Based on Transformer and CNN

CrashFormer: A Multimodal Architecture to Predict the Risk of Crash

An Attention-Based Multi-Context Convolutional Encoder-Decoder Neural Network for Work Zone Traffic Impact Prediction

Applying Spatiotemporal Attention to Identify Distracted and Drowsy Driving with Vision Transformers