Abstract:Adaptive traffic signal control plays a crucial role in enhancing the traffic situation in urban cities. Recently, reinforcement learning-based methods have demonstrated remarkable performance in addressing traffic signal control problems. However, the deployment of these methods in real-world environments is limited due to their lack of robustness. When errors occur during traffic data collection, their performance tends to deteriorate significantly. This paper addresses a prevalent issue where certain intersections, referred to as blinded intersections, cannot receive traffic data either due to hardware failures or the absence of traffic detectors. Existing adaptive traffic signal control methods fail to achieve satisfactory results in such scenarios as they are unable to learn effective policies for blinded intersections. Through theoretical analysis, we identify the primary reason behind the poor performance of existing methods as improper reward selection. To mitigate this issue, we propose a novel reward function called, which incorporates Number of Vehicles and Outflow, offering a correct optimization objective with low variance. These advantages significantly enhance the performance of reinforcement learning methods. Additionally, we introduce a new reinforcement learning model called BlindLight, which employs a dual model structure to learn Q-values for different types of intersections independently. This model design enhances the robustness of the system. Experimental results conducted on public datasets demonstrate the consistent performance improvement achieved by the theoretically supported reward function in existing methods with blinded intersections. Furthermore, BlindLight outperforms all state-of-the-art traffic signal control methods significantly.

PressLight

IPDALight: Intensity- and Phase Duration-Aware Traffic Signal Control Based on Reinforcement Learning

Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal control

PDLight: A Deep Reinforcement Learning Traffic Light Control Algorithm with Pressure and Dynamic Light Duration

DNLight: Learning Efficient Evaluation for Traffic Signal Control

Hierarchically and Cooperatively Learning Traffic Signal Control

Efficient Pressure: Improving efficiency for signalized intersections

Diagnosing Reinforcement Learning for Traffic Signal Control

MTLight: Efficient Multi-Task Reinforcement Learning for Traffic Signal Control

PhaseLight: an Universal and Practical Traffic Signal Control Algorithms Based on Reinforcement Learning

ModelLight: Model-Based Meta-Reinforcement Learning for Traffic Signal Control

SoftLight: A Maximum Entropy Deep Reinforcement Learning Approach for Intelligent Traffic Signal Control

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

MoveLight: Enhancing Traffic Signal Control through Movement-Centric Deep Reinforcement Learning

Expression is Enough: Improving Traffic Signal Control with Advanced Traffic State Representation.

Biased Pressure: Cyclic Reinforcement Learning Model for Intelligent Traffic Signal Control

BlindLight: High Robustness Reinforcement Learning Method to Solve Partially Blinded Traffic Signal Control Problem

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

SafeLight: A Reinforcement Learning Method toward Collision-free Traffic Signal Control

Learning Phase Competition for Traffic Signal Control

Efficiency and Equity are Both Essential: A Generalized Traffic Signal Controller with Deep Reinforcement Learning