Abstract:The optimization of intersection signal control can improve traffic efficiency, reduce congestion degree, and improve traffic safety. Aiming at implementing the coordinated adaptive traffic signal control (ATSC) across large-scale arterial network, multi-agent reinforcement learning (MARL) has been widely concerned and lucubrated. Nevertheless, the existing MARL-based ATSC studies suffers from several limitations: (1) While most existing researches focused on the mobility per-formance of controlled corridor, there calls for a methodology that aims at combine multi-objective performance on traffic safety, efficiency, and network coor-dination simultaneously; (2) Most methods ignore the correlations between multiple agents, nor considers the spatial-temporal dependencies among the corelated neighboring intersections due to high communications requirements, which can hardly be achieved in real adaptive coordination control. To overcome the afore-mentioned difficulties, a multi-objective reinforcement learning model (NACRL) for network-wide coordinated signal control is proposed. Firstly, to enforce a co-ordinated network control with safety and efficiency considerations, a reward mechanism inspecting both traffic safety and traffic efficiency indicators was designed to achieve ideal performance in terms of mobility, safety and smooth. Secondly, the proposed NACRL conducted a centralized training-decentralized execution framework, this overcomes the critical limitation of data transmission in the field implementation while explicitly analyzing the traffic state over the entire network instead of examining each isolated intersection. Last but not least, the proposed algorithm utilized the attention mechanism to dynamically capture the sophisticated spatial-temporal dependencies over the complex arterial network, which aids the better coordinated control over multi-agents deployed at the intersections across the corridor. To testify the effeteness of the proposed algorithm, extensive experiments were implemented in both large-scale synthetic traffic grid and real-world arterial network. The experiment demonstrated that the proposed NACRL algorithm outperforms other state-of-the-art baselines with simultaneously improved performance in terms of traffic safety, traffic efficiency and network coordination, as well as improved algorithm convergence and interpretability.

Learning Decentralized Traffic Signal Controllers with Multi-Agent Graph Reinforcement Learning

Learning Decentralized Traffic Signal Controllers with Multi-Agent Graph Reinforcement Learning

TraCo: Learning Virtual Traffic Coordinator for Cooperation with Multi-Agent Reinforcement Learning.

Network Clustering-Based Multi-Agent Reinforcement Learning for Large-Scale Traffic Signal Control

Engineering A Large-Scale Traffic Signal Control: A Multi-Agent Reinforcement Learning Approach

Multi-Agent Deep Reinforcement Learning for Urban Traffic Light Control in Vehicular Networks

Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Control

Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control

Dynamic Traffic Signal Control Using Mean Field Multi‐agent Reinforcement Learning in Large Scale Road‐networks

A multi-agent reinforcement learning based approach for intelligent traffic signal control

STMARL: A Spatio-Temporal Multi-Agent Reinforcement Learning Approach for Cooperative Traffic Light Control

Multi-Objective Traffic Signal Control Using Network-Wide Agent Coordinated Reinforcement Learning.

Adaptive Traffic Signal Control Using Distributed MARL and Federated Learning

Graph cooperation deep reinforcement learning for ecological urban traffic signal control

Network-Scale Traffic Signal Control Via Multiagent Reinforcement Learning with Deep Spatiotemporal Attentive Network

Multi-agent Deep Reinforcement Learning collaborative Traffic Signal Control method considering intersection heterogeneity

Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphs

AGRCNet: communicate by attentional graph relations in multi-agent reinforcement learning for traffic signal control

Combat Urban Congestion via Collaboration: Heterogeneous GNN-based MARL for Coordinated Platooning and Traffic Signal Control

Distributed Signal Control of Arterial Corridors Using Multi-Agent Deep Reinforcement Learning

Decentralized Deep Reinforcement Learning for Network Level Traffic Signal Control