Abstract:In recent years, the advancement of artificial intelligence techniques has led to significant interest in reinforcement learning (RL) within the traffic and transportation community. Dynamic traffic control has emerged as a prominent application field for RL in traffic systems. This paper presents a comprehensive survey of RL studies in dynamic traffic control, addressing the challenges associated with implementing RL-based traffic control strategies in practice, and identifying promising directions for future research. The first part of this paper provides a comprehensive overview of existing studies on RL-based traffic control strategies, encompassing their model designs, training algorithms, and evaluation methods. It is found that only a few studies have isolated the training and testing environments while evaluating their RL controllers. Subsequently, we examine the challenges involved in implementing existing RL-based traffic control strategies. We investigate the learning costs associated with online RL methods and the transferability of offline RL methods through simulation experiments. The simulation results reveal that online training methods with random exploration suffer from high exploration and learning costs. Additionally, the performance of offline RL methods is highly reliant on the accuracy of the training simulator. These limitations hinder the practical implementation of existing RL-based traffic control strategies. The final part of this paper summarizes and discusses a few existing efforts which attempt to overcome these challenges. This review highlights a rising volume of studies dedicated to mitigating the limitations of RL strategies, with the specific aim of enhancing their practical implementation in recent years.

On Deep Reinforcement Learning for Traffic Steering Intelligent ORAN

Uniformity of Markov Elements in Deep Reinforcement Learning for Traffic Signal Control

Intelligent Traffic Steering in Beyond 5G Open RAN based on LSTM Traffic Prediction

Intelligent O-RAN Traffic Steering for URLLC Through Deep Reinforcement Learning

Hierarchical Reinforcement Learning Based Traffic Steering in Multi-RAT 5G Deployments

Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

Machine Learning-enabled Traffic Steering in O-RAN: A Case Study on Hierarchical Learning Approach

Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

Deep Reinforcement Learning for Adaptive Traffic Signal Control

CaRL: Cascade Reinforcement Learning with State Space Splitting for O-RAN based Traffic Steering

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

Deep reinforcement learning for RAN optimization and control

Adaptive urban traffic signal control based on enhanced deep reinforcement learning

Deep reinforcement learning for traffic signal control with consistent state and reward design approach

Distributed agent-based deep reinforcement learning for large scale traffic signal control

Leveraging reinforcement learning for dynamic traffic control: A survey and challenges for field implementation

Enabling efficient routing for traffic engineering in SDN with Deep Reinforcement Learning

Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System

A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks