Abstract:Managing the mixed traffic involving connected and autonomous vehicles (CAVs) and human-driven vehicles (HVs) at a signalized intersection has become a concern of researchers. However, the performances of most existing control methods are limited, especially when CAV penetration rate is low, since they fail to make a better trade-off between safety and operational efficiency for both CAVs and HVs. To this end, this study proposes a deep reinforcement learning (DRL) powered control system for the mixed traffic at signalized intersections, which aims to optimize operational efficiency of both CAVs and HVs while assuring safety and reducing interference on HVs’ driving habits. The system adopts an adaptive traffic signal control strategy and an efficient CAV control policy with a passing rule proposed as a link in between. The traffic signal control strategy allows traffic light to adaptively adjust its phase and duration based on real-time traffic information, while the CAV control policy permits the CAVs meeting certain safety constraints to form platoons and pass through the intersection in a coordinated manner regardless of traffic signals. As an efficient DRL algorithm, Deep Q-Network (DQN) is adopted to adaptively control the signals and implement CAV coordination. The proposed system is examined on Simulation of Urban Mobility (SUMO), given different CAV penetration rates and traffic conditions. It is found that the proposed system not only outperforms the state-of-the-art control methods on reducing travel time and fuel consumption under low CAV penetration rate, but also enlarges its advantages with the increase of CAV penetration rate. In certain traffic scenarios, the proposed system can even achieve a maximum reduction of travel time by 37.33% and fuel consumption by 15.95%, in comparison to the existing method with the best performance. Besides, to some extent, the comparisons between the performances of CAVs and HVs demonstrate certain benefits of introducing CAVs into the mixed traffic.

Using Reinforcement Learning With Partial Vehicle Detection for Intelligent Traffic Signal Control

Using Reinforcement Learning With Partial Vehicle Detection for Intelligent Traffic Signal Control

Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection

Traffic Signal Control System Based on Intelligent Transportation System and Reinforcement Learning

A Deep Reinforcement Learning Approach for Isolated Intersection Traffic Signal Control with Long-Short Term Memory Network

iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvement

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Real-Time Adaptive Traffic Signal Control in a Connected and Automated Vehicle Environment: Optimisation of Signal Planning with Reinforcement Learning under Vehicle Speed Guidance

Adaptive urban traffic signal control based on enhanced deep reinforcement learning

Learning in practice: reinforcement learning-based traffic signal control augmented with actuated control

Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning

Reinforcement Learning Approaches for Traffic Signal Control under Missing Data

Managing Mixed Traffic at Signalized Intersections: an Adaptive Signal Control and CAV Coordination System Based on Deep Reinforcement Learning.

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

Research on Intelligent Signal Timing Optimization of Signalized Intersection Based on Deep Reinforcement Learning Using Floating Car Data

An Ontology-Based Intelligent Traffic Signal Control Model

Deep Reinforcement Learning for Adaptive Traffic Signal Control

A Survey on Deep Learning-Based Traffic Signal Control