Abstract:As urban traffic condition is diverse and complicated, applying reinforcement learning to reduce traffic congestion becomes one of the hot and promising topics. Especially, how to coordinate the traffic light controllers of multiple intersections is a key challenge for multi-agent reinforcement learning (MARL). Most existing MARL studies are based on traditional $Q$-learning, but unstable environment leads to poor learning in the complicated and dynamic traffic scenarios. In this paper, we propose a novel multi-agent recurrent deep deterministic policy gradient (MARDDPG) algorithm based on deep deterministic policy gradient (DDPG) algorithm for traffic light control (TLC) in vehiclar networks. Specifically, the centralized learning in each critic network enables each agent to estimate the policies of other agents in the decision-making process and each agent can coordinate with each other, alleviating the problem of poor learning performance caused by environmental instability. The decentralized execution enables each agent to make decisions independently. We share parameters in actor networks to speed up the training process and reduce the memory footprint. The addition of LSTM is beneficial to alleviate the instability of the environment caused by partial observable state. We utilize surveillance cameras and vehicular networks to collect status information for each intersection. Unlike previous work, we have not only considered the vehicle but also considered the pedestrians waiting to pass through the intersection. Moreover, we also set different priorities for buses and ordinary vehicles. The experimental results in a vehicular network show that our method can run stably in various scenarios and coordinate multiple intersections, which significantly reduces vehicle congestion and pedestrian congestion.

Urban Traffic Control in Software Defined Internet of Things via a Multi-Agent Deep Reinforcement Learning Approach

Adaptive signal control for urban traffic network gridlock

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

A multi‐agent deep reinforcement learning approach for traffic signal coordination

Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning

Intelligent Traffic Light via Policy-based Deep Reinforcement Learning

Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network

Urban Traffic Light Control Via Active Multi-agent Communication and Supply-Demand Modeling

Joint Optimization of Traffic Signal Control and Vehicle Routing in Signalized Road Networks using Multi-Agent Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Urban Traffic Light Control in Vehicular Networks

Cooperative Optimization of Traffic Signals and Vehicle Speed Using a Novel Multi-agent Deep Reinforcement Learning

A Control Method with Reinforcement Learning for Urban Un-Signalized Intersection in Hybrid Traffic Environment

Poster: Can Traffic Lights and CAV Work Together using Deep Reinforcement Learning?

An Information Fusion Approach to Intelligent Traffic Signal Control Using the Joint Methods of Multiagent Reinforcement Learning and Artificial Intelligence of Things

A Novel Multi-Agent Deep RL Approach for Traffic Signal Control

Intelligent Traffic Light Control Using Distributed Multi-agent Q Learning

Democratizing traffic control in smart cities

Deep Reinforcement Learning for Traffic Light Control in Intelligent Transportation Systems

An Edge Based Multi-Agent Auto Communication Method for Traffic Light Control

Cooperative traffic signal control through a counterfactual multi-agent deep actor critic approach

Cooperative Reinforcement Learning on Traffic Signal Control