Abstract:The optimization of intersection signal control can improve traffic efficiency, reduce congestion degree, and improve traffic safety. Aiming at implementing the coordinated adaptive traffic signal control (ATSC) across large-scale arterial network, multi-agent reinforcement learning (MARL) has been widely concerned and lucubrated. Nevertheless, the existing MARL-based ATSC studies suffers from several limitations: (1) While most existing researches focused on the mobility per-formance of controlled corridor, there calls for a methodology that aims at combine multi-objective performance on traffic safety, efficiency, and network coor-dination simultaneously; (2) Most methods ignore the correlations between multiple agents, nor considers the spatial-temporal dependencies among the corelated neighboring intersections due to high communications requirements, which can hardly be achieved in real adaptive coordination control. To overcome the afore-mentioned difficulties, a multi-objective reinforcement learning model (NACRL) for network-wide coordinated signal control is proposed. Firstly, to enforce a co-ordinated network control with safety and efficiency considerations, a reward mechanism inspecting both traffic safety and traffic efficiency indicators was designed to achieve ideal performance in terms of mobility, safety and smooth. Secondly, the proposed NACRL conducted a centralized training-decentralized execution framework, this overcomes the critical limitation of data transmission in the field implementation while explicitly analyzing the traffic state over the entire network instead of examining each isolated intersection. Last but not least, the proposed algorithm utilized the attention mechanism to dynamically capture the sophisticated spatial-temporal dependencies over the complex arterial network, which aids the better coordinated control over multi-agents deployed at the intersections across the corridor. To testify the effeteness of the proposed algorithm, extensive experiments were implemented in both large-scale synthetic traffic grid and real-world arterial network. The experiment demonstrated that the proposed NACRL algorithm outperforms other state-of-the-art baselines with simultaneously improved performance in terms of traffic safety, traffic efficiency and network coordination, as well as improved algorithm convergence and interpretability.

Joint Traffic Control and Multi-Channel Reassignment for Core Backbone Network in SDN-IoT: A Multi-Agent Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Smart City Communication Networks

A Multi-objective Reinforcement Learning Perspective on Internet Congestion Control

DeepCC: Multi-Agent Deep Reinforcement Learning Congestion Control for Multi-Path TCP Based on Self-Attention

Congestion Control in SDN-Based Networks via Multi-Task Deep Reinforcement Learning

Multi-Agent Reinforcement Learning Framework in SDN-IoT for Transient Load Detection and Prevention

A Temporal Deep Q Learning for Optimal Load Balancing in Software-Defined Networks

Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based Networks.

MA-CDMR: An Intelligent Cross-domain Multicast Routing Method based on Multiagent Deep Reinforcement Learning in Multi-domain SDWN

Distributed Traffic Engineering in Hybrid Software Defined Networks: A Multi-agent Reinforcement Learning Framework

Intelligent Resource Allocation for Train-to-Train Communication: A Multi-Agent Deep Reinforcement Learning Approach.

Request Dispatching Over Distributed SDN Control Plane: A Multiagent Approach

Joint SDN Synchronization and Controller Placement in Wireless Networks using Deep Reinforcement Learning

Dynamic Controller Assignment in Software Defined Internet of Vehicles Through Multi-Agent Deep Reinforcement Learning

Multi-Objective Traffic Signal Control Using Network-Wide Agent Coordinated Reinforcement Learning.

MACC: Cross-Layer Multi-Agent Congestion Control with Deep Reinforcement Learning

Joint Optimization of Traffic Signal Control and Vehicle Routing in Signalized Road Networks using Multi-Agent Deep Reinforcement Learning

DeepCC: Bridging the Gap Between Congestion Control and Applications Via Multiobjective Optimization

MARVEL: Enabling controller load balancing in software-defined networks with multi-agent reinforcement learning

DeepCC: Bridging the Gap Between Congestion Control and Applications via Multi-Objective Optimization

MA-CC: Cross-Layer Congestion Control via Multi-agent Reinforcement Learning