Abstract:Reliable prediction of traffic accidents is crucial for the identification of potential hazards in advance, formulation of effective preventative measures, and reduction of accident incidence. Existing neural network-based models generally suffer from a limited field of perception and poor long-term dependency capturing abilities, which severely restrict their performance. To address the inherent shortcomings of current traffic prediction models, we propose the Traffic Transformer for multidimensional, multi-step traffic accident prediction. Initially, raw datasets chronicling sporadic traffic accidents are transformed into multivariate, regularly sampled sequences that are amenable to sequential modeling through a temporal discretization process. Subsequently, Traffic Transformer captures and learns the hidden relationships between any elements of the input sequence, constructing accurate prediction for multiple forthcoming intervals of traffic accidents. Our proposed Traffic Transformer employs the sophisticated multi-head attention mechanism in lieu of the widely used recurrent architecture. This significant shift enhances the model's ability to capture long-range dependencies within time series data. Moreover, it facilitates a more flexible and comprehensive learning of diverse hidden patterns within the sequences. It also offers the versatility of convenient extension and transference to other diverse time series forecasting tasks, demonstrating robust potential for further development in this field. Extensive comparative experiments conducted on a real-world dataset from Qatar demonstrate that our proposed Traffic Transformer model significantly outperforms existing mainstream time series forecasting models across all evaluation metrics and forecast horizons. Notably, its Mean Absolute Percentage Error reaches a minimal value of only 4.43%, which is substantially lower than the error rates observed in other models. This remarkable performance underscores the Traffic Transformer's state-of-the-art level of in predictive accuracy.

Asphalt Pavement Health Prediction Based on Improved Transformer Network

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

Research and comparison of pavement performance prediction based on neural networks and fusion transformer architecture

Numerical Modeling and Artificial Neural Network for Predicting J-Integral of Top-Down Cracking in Asphalt Pavement

Imporved Model for Pavement Performance Prediction Based on Recurrent Neural Network Using LTPP Database

Automated pixel-level pavement marking detection based on a convolutional transformer

A Detection and Classification Method of Asphalt Pavement Crack based on Vision Transformer

Performance prediction for network-level flexible pavements using an optimised ANN approach

Pavement crack detection based on transformer network

Use of recurrent neural networks considering maintenance to predict urban road performance in Beijing, China

Recurrent Neural Networks for Pavement Performance Forecasting: Review and Model Performance Comparison

Data cleaning framework for highway asphalt pavement inspection data based on artificial neural networks

A Data-Driven Rutting Depth Short-Time Prediction Model with Metaheuristic Optimization for Asphalt Pavements Based on RIOHTrack

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction

ADCT-Net: Adaptive traffic forecasting neural network via dual-graphic cross-fused transformer

A novel transformer-based network with attention mechanism for automatic pavement crack detection

An ensemble learning model for asphalt pavement performance prediction based on gradient boosting decision tree

Transformer network with decoupled spatial–temporal embedding for traffic flow forecasting

Rutting prediction and analysis of influence factors based on multivariate transfer entropy and graph neural networks

STTF: An Efficient Transformer Model for Traffic Congestion Prediction

Automatic Pavement Crack Detection Transformer Based on Convolutional and Sequential Feature Fusion