Abstract:Most of the existing traffic signal control strategies are hard to satisfy the real-time requirements of traffic big data analysis, knowledge reasoning and decision making for sophisticated traffic dynamics and heterogeneous intersection structures in the context of Internet of Vehicles (IoV). In this paper, we attempt to propose a cooperative multi-agent actor–critic (CMAC) deep reinforcement learning (DRL) approach with value decomposition based on edge computing architecture. The intuition behind CMAC is to decompose the global actor–critic learning tasks into several local actor–critic sub-problems with respect to each intersection. Each agent searches the local optimal decision by actor–critic network that takes the discrete state encoding about several consecutive frames of image-like traffic states as the inputs of the network. Among them, the green ratio output strategy considering multiple constraints is formulated in the output layer of the actor network, so that the continuous control of traffic signals using multi-agent DRL (MADRL) can be realized. Furthermore, a cooperative mechanism that considers contribution weight distributions of local agents to the global traffic pattern is proposed to coordinate multiple local agents to evolve toward global optimization. Especially, some parallel training tasks of CMAC with a large number of computing loads are deployed on the cloud side in the edge computing architecture to accelerate learning and reconstructing knowledge. The well-trained multi-agent model is downloaded from the cloud side into the edge side for real-time decision making of traffic network flow adaptive control. Simulation results with regard to a realistic traffic network demonstrate that the proposed CMAC approach under edge computing architecture outperforms the value-decomposition based multi-agent actor–critic (VMAC), independent multi-agent actor–critic (IMAC), and the fixed timing control (FTC) in terms of alleviating traffic congestion.

Cooperative Multi-Agent Reinforcement Learning Framework for Edge Intelligence Empowered Traffic Light Control

TraCo: Learning Virtual Traffic Coordinator for Cooperation with Multi-Agent Reinforcement Learning.

Multi-Agent Attention Double Actor-Critic Framework for Intelligent Traffic Light Control in Urban Scenarios With Hybrid Traffic

Cooperative Reinforcement Learning on Traffic Signal Control

Binding of [3H]muscimol to calf cerebrocortical synaptic membranes and the effects of sulphur-containing convulsant and non-convulsant compounds

Cooperative Traffic Signal Control Using a Distributed Agent-Based Deep Reinforcement Learning With Incentive Communication

Urban Traffic Light Control Via Active Multi-Agent Communication and Supply-Demand Modeling

An Information Fusion Approach to Intelligent Traffic Signal Control Using the Joint Methods of Multiagent Reinforcement Learning and Artificial Intelligence of Things

Cooperative Multi-Agent Actor–critic Control of Traffic Network Flow Based on Edge Computing

Real-Time Network-Level Traffic Signal Control: An Explicit Multiagent Coordination Method

Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control

Cooperative traffic signal control through a counterfactual multi-agent deep actor critic approach

Cooperative Multi-Objective Reinforcement Learning for Traffic Signal Control and Carbon Emission Reduction

Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphs

Two-layer Coordinated Reinforcement Learning for Traffic Signal Control in Traffic Network

Reader response: Burnout, career satisfaction, and well-being among US neurology residents and fellows in 2016

Integrating independent and centralized multi-agent reinforcement learning for traffic signal network optimization

MixLight: Mixed-Agent Cooperative Reinforcement Learning for Traffic Light Control

Multi-Agent Reinforcement Learning for Traffic Signal Control: A Cooperative Approach

A Cooperative Multiagent System for Traffic Signal Control Using Game Theory and Reinforcement Learning

A multi-agent reinforcement learning method with curriculum transfer for large-scale dynamic traffic signal control