Abstract:Signal control has been effective to alleviate urban traffic congestion. Massive related works about signal timing optimization have been proposed and led to many signal control methods and systems. In recent years, reinforcement learning (RL) algorithms have attracted the increasing attention of researchers in the area of signal control optimization, since they can learn the optimal timing policy themselves by analyzing changing patterns between the traffic condition and signal timing plans. Multi-intersection traffic signal control problems face more challenges than classical single intersection problems such as the dimensionality issue as the joint action space of multiple agents grows exponentially with the number of intersections. The existing state-of-art multi-agent reinforcement learning algorithms developed for other areas may not suit well with traffic signal control given the complex spatial–temporal nature of traffic flows. In this paper, we propose a novel multi-agent counterfactual actor–critic with scheduler (MACS) framework for multiple interactions. In this method, decentralized actors control the traffic signals and the centralized critic combines recurrent policies with feed-forward critics. Additionally, a scheduler module that exchanges information among agents helps the individual agent better understand the entire environment. The proposed method was evaluated using simulation experiments based on a real-world urban street network in Shenzhen, China. Results showed that the proposed method outperforms the classic model-based method and several existing RL-based methods according to different measures such as queue length, average travel time delay, and throughput.

A Multi-Agent Adaptive Traffic Signal Control System Using Swarm Intelligence and Neuro-Fuzzy Reinforcement Learning

TraCo: Learning Virtual Traffic Coordinator for Cooperation with Multi-Agent Reinforcement Learning.

Mean Field Multi-Agent Reinforcement Learning Method for Area Traffic Signal Control

A multi-agent reinforcement learning based approach for intelligent traffic signal control

Multi-agent Fuzzy Signal Control with Bus Priority

An Information Fusion Approach to Intelligent Traffic Signal Control Using the Joint Methods of Multiagent Reinforcement Learning and Artificial Intelligence of Things

Cooperative traffic signal control through a counterfactual multi-agent deep actor critic approach

A New Design of Intelligent Traffic Signal Control

A multi‐agent deep reinforcement learning approach for traffic signal coordination

Fuzzy Neural Network Control Technique and Its Application in A Complex Intersection

Network Clustering-Based Multi-Agent Reinforcement Learning for Large-Scale Traffic Signal Control

An Intelligent Control Method for Urban Traffic Signal Based on Fuzzy Neural Network

Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network

Distributed Signal Control of Arterial Corridors Using Multi-Agent Deep Reinforcement Learning

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Improving the Urban Transport System Resilience Through Adaptive Traffic Signal Control Enabled by Decentralised Multiagent Reinforcement Learning

A Novel Multi-Agent Deep RL Approach for Traffic Signal Control

Intelligent Traffic Control Decision-Making Based on Type-2 Fuzzy and Reinforcement Learning

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Two-layer Coordinated Reinforcement Learning for Traffic Signal Control in Traffic Network

Multi-agent Reinforcement Traffic Signal Control based on Interpretable Influence Mechanism and Biased ReLU Approximation