Abstract:Traffic signal control has always been a hot topic in the field of intelligent transportation. With the increasing complexity of urban traffic conditions due to urbanization, how to develop effective scheduling strategies to adapt to the changing traffic demands has become a key problem in current intelligent transportation. In light of this, this paper focuses on the traffic signal control problem at intersections and proposes a composite intelligent traffic signal control model based on heterogeneous graph neural networks with dual attention mechanisms and deep reinforcement learning. For the first time, the model incorporates the dual attention mechanism in graph neural networks into the traffic signal control, integrating graph neural networks with deep reinforcement learning techniques and traffic intersection scenarios. This allows for the construction of traffic condition models and the scheduling control of traffic resources, catering to the perception and decision-making needs in complex traffic environments. Firstly, the graph relationship representation of intersection resources is established, constructing the graph information structure for traffic flow and signal states. Then, a heterogeneous graph neural network is designed, incorporating both node-level and semantic-level dual attention mechanisms to characterize the traffic state and explore the relationships, enabling the extraction of explicit and implicit information in traffic intersections. Lastly, a deep reinforcement learning algorithm that combines Double Deep Q-Network (DDQN) and Dueling DQN is implemented to improve the algorithm's generalization and execution efficiency, enhancing the adaptability and stability of traffic signal scheduling in complex environments. Simulation tests are conducted on the SUMO simulation platform using real-world application datasets. Compared to four other similar traffic control model, the proposed model demonstrates performance advantages of more than 13% in terms of average reward, average delay, queue length, and waiting time. This validates the effectiveness of the proposed model.

Adaptive Traffic Signal Control Based on Neural Network Prediction of Weighted Traffic Flow

A deterministic predictive traffic signal control model in intelligent transportation and geoinformation systems

A Semi-"Smart Predict, then Optimize" Method for Traffic Signal Control.

A Decentralized Model Predictive Traffic Signal Control Method with Fixed Phase Sequence for Urban Networks.

Daily Long-Term Traffic Flow Forecasting Based on a Deep Neural Network

Adaptive Traffic Signal Control: Deep Reinforcement Learning Algorithm with Experience Replay and Target Network

Traffic Flow Prediction for Smart Traffic Lights Using Machine Learning Algorithms

Network-Wide Traffic State Estimation and Rolling Horizon-Based Signal Control Optimization in a Connected Vehicle Environment

Adaptive Traffic Signal Control With Deep Reinforcement Learning and High Dimensional Sensory Inputs: Case Study and Comprehensive Sensitivity Analyses

An Intelligent Control Method for Urban Traffic Signal Based on Fuzzy Neural Network

Short-Term Traffic Flow Prediction and Signal Timing Optimization Based on Deep Learning

Traffic Signal Control Optimization Based on Neural Network in the Framework of Model Predictive Control

Optimization of Control Parameters for Adaptive Traffic-Actuated Signal Control

Development of intelligent system for automated traffic control

Variable-length traffic state prediction and applications for urban network with adaptive signal timing plan

Time-to-Green Predictions for Fully-Actuated Signal Control Systems With Supervised Learning

Data-driven traffic signal adaptive control algorithm integrating vehicle perception and traffic flow data

A New Design of Intelligent Traffic Signal Control

Cooperative Control for Signalized Intersections in Intelligent Connected Vehicle Environments

Enhancing traffic signal control with composite deep intelligence

A Method of Reinforcement Learning Based Automatic Traffic Signal Control