Abstract:The primary purpose is to manage multiple traffic signals in a road network in order to mitigate traffic congestion. To accomplish this, two deep reinforcement learning‐based approaches, advantage actor‐critic and proximal policy optimization, are incorporated with edge computing and intelligent transportation system. Moreover, the proposed agent explores various deep neural networks, including the state‐of‐the‐art transformer network. In the current era, the coordination of traffic flow is hindered by the discrepancy between road infrastructure and the number of vehicles which leads to traffic congestion. One of the widely used strategies to mitigate traffic congestion is to control traffic signals with the help of deep reinforcement learning (DRL) in edge computing based intelligent transportation system. This article provides a comprehensive analysis of the most recent DRL algorithms, advantage actor‐critic and proximal policy optimization in multiple deep neural networks (DNNs), including a state‐of‐the‐art transformer model for effective traffic signal management. Here, a single DRL agent is used, which obtains the spatio‐temporal information of the traffic to identify traffic patterns from complex intersection environments. The agent uses this information as the input to the DNNs and then applies the algorithms to retrieve the essential parameters of DNN to seek an optimal action selection policy to mitigate congestion. Different real‐time maps and small city networks are explored here to determine which DNN is best suited for traffic congestion management. The simulation study reveals that both the algorithms significantly outperform the baseline. The transformer model gives the best result when compared to other DNNs. The transformer model decreases average waiting time by 96.16%, implying that it has a higher capability of dealing with congested environments.

Energy efficient deep reinforcement learning approach to control the traffic flow in iot networks for smart city

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Scalable Traffic Signal Controls using Fog-Cloud Based Multiagent Reinforcement Learning

Deep reinforcement learning based cooperative control of traffic signal for multi‐intersection network in intelligent transportation system using edge computing

Distributed agent-based deep reinforcement learning for large scale traffic signal control

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphs

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

Deep Reinforcement Learning for Traffic Light Control in Intelligent Transportation Systems

EcoMRL: Deep reinforcement learning-based traffic signal control for urban air quality

Deep Reinforcement Learning for Adaptive Traffic Signal Control

Adaptive Traffic Signal Control Based on Graph Neural Networks and Dynamic Entropy-Constrained Soft Actor–Critic

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Fuzzy Inference Enabled Deep Reinforcement Learning-Based Traffic Light Control for Intelligent Transportation System

Deep Reinforcement Learning-based Intelligent Traffic Signal Controls with Optimized CO2 emissions

Network-wide Traffic Signal Control Based on the Discovery of Critical Nodes and Deep Reinforcement Learning

Adaptive Traffic Signal Control With Deep Reinforcement Learning and High Dimensional Sensory Inputs: Case Study and Comprehensive Sensitivity Analyses

Traffic Flow Management of Autonomous Vehicles Using Deep Reinforcement Learning and Smart Rerouting

A multi‐agent deep reinforcement learning approach for traffic signal coordination

Adaptive urban traffic signal control based on enhanced deep reinforcement learning