Abstract:To alleviate intersection traffic congestion and reduce carbon emissions at intersections, research on exploiting reinforcement learning for intersection signal control has become a frontier topic in the field of intelligent transportation. This study utilizes a deep reinforcement learning algorithm based on the D3QN (dueling double deep Q network) to achieve adaptive control of signal timings. Under a mixed traffic environment with connected and automated vehicles (CAVs) and human-driven vehicles (HDVs), this study constructs a reward function (Reward—CO2 Reduction) to minimize vehicle waiting time and carbon dioxide emissions at the intersection. Additionally, to account for the spatiotemporal distribution characteristics of traffic flow, an adaptive-phase action space and a fixed-phase action space are designed to optimize action selections. The proposed algorithm is validated in a SUMO simulation with different traffic volumes and CAV penetration rates. The experimental results are compared with other control strategies like Webster’s method (fixed-time control). The analysis shows that the proposed model can effectively reduce carbon dioxide emissions when the traffic volume is low or medium. As the penetration rate of CAVs increases, the average carbon dioxide emissions and waiting time can be further reduced with the proposed model. The significance of this study lies in its dual achievement: by presenting a flexible strategy that not only reduces the environmental impact by lowering carbon dioxide emissions but also enhances traffic efficiency, it provides a tangible example of the advancement of green intelligent transportation systems.

Network-wide Traffic Signal Control Based on the Discovery of Critical Nodes and Deep Reinforcement Learning

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

A Decentralized Model Predictive Traffic Signal Control Method with Fixed Phase Sequence for Urban Networks.

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Traffic Light Control in Vehicular Networks

A multi‐agent deep reinforcement learning approach for traffic signal coordination

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Adaptive urban traffic signal control based on enhanced deep reinforcement learning

Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning

Network-level Signal Predictive Control with Real-Time Routing Information

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study

Deep Reinforcement Learning for Adaptive Traffic Signal Control

Mitigating Action Hysteresis in Traffic Signal Control with Traffic Predictive Reinforcement Learning

Graph Topography-Aware Reinforcement Learning for Intelligent Traffic Signal Control

Adaptive Traffic Signal Control with Deep Reinforcement Learning An Exploratory Investigation

An Intelligent Traffic Signal Control System Based on Deep Reinforcement Learning

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

Carbon Dioxide Emission Reduction-Oriented Optimal Control of Traffic Signals in Mixed Traffic Flow Based on Deep Reinforcement Learning

Multi-agent Reinforcement Traffic Signal Control based on Interpretable Influence Mechanism and Biased ReLU Approximation