Abstract:Reliable prediction of traffic accidents is crucial for the identification of potential hazards in advance, formulation of effective preventative measures, and reduction of accident incidence. Existing neural network-based models generally suffer from a limited field of perception and poor long-term dependency capturing abilities, which severely restrict their performance. To address the inherent shortcomings of current traffic prediction models, we propose the Traffic Transformer for multidimensional, multi-step traffic accident prediction. Initially, raw datasets chronicling sporadic traffic accidents are transformed into multivariate, regularly sampled sequences that are amenable to sequential modeling through a temporal discretization process. Subsequently, Traffic Transformer captures and learns the hidden relationships between any elements of the input sequence, constructing accurate prediction for multiple forthcoming intervals of traffic accidents. Our proposed Traffic Transformer employs the sophisticated multi-head attention mechanism in lieu of the widely used recurrent architecture. This significant shift enhances the model's ability to capture long-range dependencies within time series data. Moreover, it facilitates a more flexible and comprehensive learning of diverse hidden patterns within the sequences. It also offers the versatility of convenient extension and transference to other diverse time series forecasting tasks, demonstrating robust potential for further development in this field. Extensive comparative experiments conducted on a real-world dataset from Qatar demonstrate that our proposed Traffic Transformer model significantly outperforms existing mainstream time series forecasting models across all evaluation metrics and forecast horizons. Notably, its Mean Absolute Percentage Error reaches a minimal value of only 4.43%, which is substantially lower than the error rates observed in other models. This remarkable performance underscores the Traffic Transformer's state-of-the-art level of in predictive accuracy.

Enhancing road traffic flow in sustainable cities through transformer models: Advancements and challenges

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

STTF: An Efficient Transformer Model for Traffic Congestion Prediction

Predictive analytics for traffic flow optimization in urban logistics: A transformer-based time series approach

A Vision Transformer Approach for Traffic Congestion Prediction in Urban Areas

TST-Trans: A Transformer Network for Urban Traffic Flow Prediction

Traffic flow prediction based on transformer

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction

Transformer network with decoupled spatial–temporal embedding for traffic flow forecasting

Mitigating Partial Observability in Adaptive Traffic Signal Control with Transformers

A Multi-Channel Spatial-Temporal Transformer Model for Traffic Flow Forecasting

Machine Learning-Based Traffic Flow Prediction and Intelligent Traffic Management

An Enhanced Analysis of Traffic Intelligence in Smart Cities Using Sustainable Deep Radial Function

A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networks

Learning dynamic and hierarchical traffic spatiotemporal features with Transformer

Towards Green Innovation in Smart Cities: Leveraging Traffic Flow Prediction with Machine Learning Algorithms for Sustainable Transportation Systems

Building Transportation Foundation Model via Generative Graph Transformer

Transformative effects of connectivity technologies on urban infrastructure and services in smart cities

Enhancing urban mobility: integration of IoT road traffic data and artificial intelligence in smart city environment

Artificial intelligence-based traffic flow prediction: a comprehensive review

A Multi-Layer Model Based on Transformer and Deep Learning for Traffic Flow Prediction