Abstract:Traffic signal control has always been a hot topic in the field of intelligent transportation. With the increasing complexity of urban traffic conditions due to urbanization, how to develop effective scheduling strategies to adapt to the changing traffic demands has become a key problem in current intelligent transportation. In light of this, this paper focuses on the traffic signal control problem at intersections and proposes a composite intelligent traffic signal control model based on heterogeneous graph neural networks with dual attention mechanisms and deep reinforcement learning. For the first time, the model incorporates the dual attention mechanism in graph neural networks into the traffic signal control, integrating graph neural networks with deep reinforcement learning techniques and traffic intersection scenarios. This allows for the construction of traffic condition models and the scheduling control of traffic resources, catering to the perception and decision-making needs in complex traffic environments. Firstly, the graph relationship representation of intersection resources is established, constructing the graph information structure for traffic flow and signal states. Then, a heterogeneous graph neural network is designed, incorporating both node-level and semantic-level dual attention mechanisms to characterize the traffic state and explore the relationships, enabling the extraction of explicit and implicit information in traffic intersections. Lastly, a deep reinforcement learning algorithm that combines Double Deep Q-Network (DDQN) and Dueling DQN is implemented to improve the algorithm's generalization and execution efficiency, enhancing the adaptability and stability of traffic signal scheduling in complex environments. Simulation tests are conducted on the SUMO simulation platform using real-world application datasets. Compared to four other similar traffic control model, the proposed model demonstrates performance advantages of more than 13% in terms of average reward, average delay, queue length, and waiting time. This validates the effectiveness of the proposed model.

An Intelligent Traffic Signal Control System Based on Deep Reinforcement Learning

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Low Carbon City Traffic Signal Control Based on Deep Reinforcement Learning

Optimization Control of Adaptive Traffic Signal with Deep Reinforcement Learning

Deep Reinforcement Learning for Intersection Signal Control Considering Pedestrian Behavior

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Adaptive Traffic Signal Control with Deep Recurrent Q-learning

Traffic light control with reinforcement learning

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study

A Method of Reinforcement Learning Based Automatic Traffic Signal Control

Intelligent Traffic Light Switch Based on Deep Reinforcement Learning with Attention Mechanism

Carbon Dioxide Emission Reduction-Oriented Optimal Control of Traffic Signals in Mixed Traffic Flow Based on Deep Reinforcement Learning

A Resilient Intelligent Traffic Signal Control Scheme for Accident Scenario at Intersections via Deep Reinforcement Learning

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Enhancing traffic signal control with composite deep intelligence

Reinforcement Learning-Based Intelligent Traffic Signal Control Considering Sensing Information of Railway

Intelligent Traffic Control Decision-Making Based on Type-2 Fuzzy and Reinforcement Learning

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach