Abstract:Adaptive traffic signal control plays a crucial role in enhancing the traffic situation in urban cities. Recently, reinforcement learning-based methods have demonstrated remarkable performance in addressing traffic signal control problems. However, the deployment of these methods in real-world environments is limited due to their lack of robustness. When errors occur during traffic data collection, their performance tends to deteriorate significantly. This paper addresses a prevalent issue where certain intersections, referred to as blinded intersections, cannot receive traffic data either due to hardware failures or the absence of traffic detectors. Existing adaptive traffic signal control methods fail to achieve satisfactory results in such scenarios as they are unable to learn effective policies for blinded intersections. Through theoretical analysis, we identify the primary reason behind the poor performance of existing methods as improper reward selection. To mitigate this issue, we propose a novel reward function called, which incorporates Number of Vehicles and Outflow, offering a correct optimization objective with low variance. These advantages significantly enhance the performance of reinforcement learning methods. Additionally, we introduce a new reinforcement learning model called BlindLight, which employs a dual model structure to learn Q-values for different types of intersections independently. This model design enhances the robustness of the system. Experimental results conducted on public datasets demonstrate the consistent performance improvement achieved by the theoretically supported reward function in existing methods with blinded intersections. Furthermore, BlindLight outperforms all state-of-the-art traffic signal control methods significantly.

BlindLight: High Robustness Reinforcement Learning Method to Solve Partially Blinded Traffic Signal Control Problem

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Uniformity of Markov Elements in Deep Reinforcement Learning for Traffic Signal Control

SafeLight: A Reinforcement Learning Method toward Collision-free Traffic Signal Control

DNLight: Learning Efficient Evaluation for Traffic Signal Control

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Reinforcement Learning Approaches for Traffic Signal Control under Missing Data

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

ModelLight: Model-Based Meta-Reinforcement Learning for Traffic Signal Control

A Deep Reinforcement Learning Approach for Isolated Intersection Traffic Signal Control with Long-Short Term Memory Network

Diagnosing Reinforcement Learning for Traffic Signal Control

Hierarchically and Cooperatively Learning Traffic Signal Control

A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning

SoftLight: A Maximum Entropy Deep Reinforcement Learning Approach for Intelligent Traffic Signal Control

ADLight: A Universal Approach of Traffic Signal Control with Augmented Data Using Reinforcement Learning

Deep Reinforcement Learning for Traffic Light Control in Vehicular Networks

DataLight: Offline Data-Driven Traffic Signal Control

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Reinforcement Learning-Based Adaptive Optimal Control Model for Signal Light in Intelligent Transportation Systems

Adaptive urban traffic signal control based on enhanced deep reinforcement learning