Abstract:In recent years, the advancement of artificial intelligence techniques has led to significant interest in reinforcement learning (RL) within the traffic and transportation community. Dynamic traffic control has emerged as a prominent application field for RL in traffic systems. This paper presents a comprehensive survey of RL studies in dynamic traffic control, addressing the challenges associated with implementing RL-based traffic control strategies in practice, and identifying promising directions for future research. The first part of this paper provides a comprehensive overview of existing studies on RL-based traffic control strategies, encompassing their model designs, training algorithms, and evaluation methods. It is found that only a few studies have isolated the training and testing environments while evaluating their RL controllers. Subsequently, we examine the challenges involved in implementing existing RL-based traffic control strategies. We investigate the learning costs associated with online RL methods and the transferability of offline RL methods through simulation experiments. The simulation results reveal that online training methods with random exploration suffer from high exploration and learning costs. Additionally, the performance of offline RL methods is highly reliant on the accuracy of the training simulator. These limitations hinder the practical implementation of existing RL-based traffic control strategies. The final part of this paper summarizes and discusses a few existing efforts which attempt to overcome these challenges. This review highlights a rising volume of studies dedicated to mitigating the limitations of RL strategies, with the specific aim of enhancing their practical implementation in recent years.

Recent Advances in Reinforcement Learning for Traffic Signal Control

A Survey on Reinforcement Learning Models and Algorithms for Traffic Signal Control

A Survey on Traffic Signal Control Methods.

A survey on deep reinforcement learning approaches for traffic signal control

Reinforcement Learning Approaches for Traffic Signal Control under Missing Data

Leveraging reinforcement learning for dynamic traffic control: A survey and challenges for field implementation

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

A survey on reinforcement learning-based control for signalized intersections with connected automated vehicles

Diagnosing Reinforcement Learning for Traffic Signal Control

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey

Traffic Signal Timing via Parallel Reinforcement Learning

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

Deep Reinforcement Learning for Adaptive Traffic Signal Control

A Deep Reinforcement Learning Approach for Fair Traffic Signal Control

Reinforcement Learning-Based Intelligent Traffic Signal Control Considering Sensing Information of Railway

Model-Based Deep Reinforcement Learning with Traffic Inference for Traffic Signal Control

Urban Traffic Signal Control with Reinforcement Learning from Demonstration Data

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study