Abstract:To alleviate intersection traffic congestion and reduce carbon emissions at intersections, research on exploiting reinforcement learning for intersection signal control has become a frontier topic in the field of intelligent transportation. This study utilizes a deep reinforcement learning algorithm based on the D3QN (dueling double deep Q network) to achieve adaptive control of signal timings. Under a mixed traffic environment with connected and automated vehicles (CAVs) and human-driven vehicles (HDVs), this study constructs a reward function (Reward—CO2 Reduction) to minimize vehicle waiting time and carbon dioxide emissions at the intersection. Additionally, to account for the spatiotemporal distribution characteristics of traffic flow, an adaptive-phase action space and a fixed-phase action space are designed to optimize action selections. The proposed algorithm is validated in a SUMO simulation with different traffic volumes and CAV penetration rates. The experimental results are compared with other control strategies like Webster’s method (fixed-time control). The analysis shows that the proposed model can effectively reduce carbon dioxide emissions when the traffic volume is low or medium. As the penetration rate of CAVs increases, the average carbon dioxide emissions and waiting time can be further reduced with the proposed model. The significance of this study lies in its dual achievement: by presenting a flexible strategy that not only reduces the environmental impact by lowering carbon dioxide emissions but also enhances traffic efficiency, it provides a tangible example of the advancement of green intelligent transportation systems.

Vehicle Emission Control on Road with Temporal Traffic Information Using Deep Reinforcement Learning

Emission Mitigation Via Longitudinal Control of Intelligent Vehicles in A Congested Platoon

Carbon Dioxide Emission Reduction-Oriented Optimal Control of Traffic Signals in Mixed Traffic Flow Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

Deep Reinforcement Learning for Traffic Light Control in Vehicular Networks

Deep Reinforcement Learning-based Intelligent Traffic Signal Controls with Optimized CO2 emissions

EcoMRL: Deep reinforcement learning-based traffic signal control for urban air quality

Adaptive Traffic Signal Control with Deep Reinforcement Learning An Exploratory Investigation

An Intelligent Traffic Signal Control System Based on Deep Reinforcement Learning

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

Deep Spatiotemporal Residual Early-Late Fusion Network for City Region Vehicle Emission Pollution Prediction

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Deep reinforcement learning and reward shaping based eco-driving control for automated HEVs among signalized intersections

An Efficient Deep Reinforcement Learning Model for Urban Traffic Control

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study

Improved Deep Reinforcement Learning for Intelligent Traffic Signal Control Using ECA_LSTM Network

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

Differential Variable Speed Limits Control for Freeway Recurrent Bottlenecks via Deep Reinforcement learning

Deep Reinforcement Learning for the Joint Control of Traffic Light Signaling and Vehicle Speed Advice

High-resolution mapping of regional traffic emissions using land-use machine learning models