Abstract:The self-adaptive traffic signal control system serves as an effective measure for relieving urban traffic congestion. The system is capable of adjusting the signal timing parameters in real time according to the seasonal changes and short-term fluctuation of traffic demand, resulting in improvement of the efficiency of traffic operation on urban road networks. The development of information technologies on computing science, autonomous driving, vehicle-to-vehicle, and mobile Internet has created a sufficient abundance of acquisition means for traffic data. Great improvements for data acquisition include the increase of available amount of holographic data, available data types, and accuracy. The article investigates the development of commonly used self-adaptive signal control systems in the world, their technical characteristics, the current research status of self-adaptive control methods, and the signal control methods for heterogeneous traffic flow composed of connected vehicles and autonomous vehicles. Finally, the article concluded that signal control based on multiagent reinforcement learning is a kind of closed-loop feedback adaptive control method, which outperforms many counterparts in terms of real-time characteristic, accuracy, and self-learning and therefore will be an important research focus of control method in future due to the property of “model-free” and “self-learning” that well accommodates the abundance of traffic information data. Besides, it will also provide an entry point and technical support for the development of Vehicle-to-X systems, Internet of vehicles, and autonomous driving industries. Therefore, the related achievements of the adaptive control system for the future traffic environment have extremely broad application prospects.

An End-to-End Recommendation System for Urban Traffic Controls and Management Under a Parallel Learning Framework

An Agent-Based Traffic Recommendation System: Revisiting and Revising Urban Traffic Management Strategies

Traffic Signal Timing via Parallel Reinforcement Learning

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Reinforcement Learning-Based Adaptive Optimal Control Model for Signal Light in Intelligent Transportation Systems

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

PRECOM: A Parallel Recommendation Engine for Control, Operations, and Management on Congested Urban Traffic Networks

DNLight: Learning Efficient Evaluation for Traffic Signal Control

A Review of the Self-Adaptive Traffic Signal Control System Based on Future Traffic Environment

A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

Network-wide Traffic Signal Control Based on the Discovery of Critical Nodes and Deep Reinforcement Learning

Learning to Recommend Signal Plans under Incidents with Real-Time Traffic Prediction

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Deep Reinforcement Learning for the Joint Control of Traffic Light Signaling and Vehicle Speed Advice

Adaptive Traffic Signal Control: Deep Reinforcement Learning Algorithm with Experience Replay and Target Network

An Intelligent Traffic Signal Control System Based on Deep Reinforcement Learning

Mitigating Action Hysteresis in Traffic Signal Control with Traffic Predictive Reinforcement Learning

An Information Fusion Approach to Intelligent Traffic Signal Control Using the Joint Methods of Multiagent Reinforcement Learning and Artificial Intelligence of Things