Abstract:Managing the mixed traffic involving connected and autonomous vehicles (CAVs) and human-driven vehicles (HVs) at a signalized intersection has become a concern of researchers. However, the performances of most existing control methods are limited, especially when CAV penetration rate is low, since they fail to make a better trade-off between safety and operational efficiency for both CAVs and HVs. To this end, this study proposes a deep reinforcement learning (DRL) powered control system for the mixed traffic at signalized intersections, which aims to optimize operational efficiency of both CAVs and HVs while assuring safety and reducing interference on HVs’ driving habits. The system adopts an adaptive traffic signal control strategy and an efficient CAV control policy with a passing rule proposed as a link in between. The traffic signal control strategy allows traffic light to adaptively adjust its phase and duration based on real-time traffic information, while the CAV control policy permits the CAVs meeting certain safety constraints to form platoons and pass through the intersection in a coordinated manner regardless of traffic signals. As an efficient DRL algorithm, Deep Q-Network (DQN) is adopted to adaptively control the signals and implement CAV coordination. The proposed system is examined on Simulation of Urban Mobility (SUMO), given different CAV penetration rates and traffic conditions. It is found that the proposed system not only outperforms the state-of-the-art control methods on reducing travel time and fuel consumption under low CAV penetration rate, but also enlarges its advantages with the increase of CAV penetration rate. In certain traffic scenarios, the proposed system can even achieve a maximum reduction of travel time by 37.33% and fuel consumption by 15.95%, in comparison to the existing method with the best performance. Besides, to some extent, the comparisons between the performances of CAVs and HVs demonstrate certain benefits of introducing CAVs into the mixed traffic.

An Integrated MPC and Deep Reinforcement Learning Approach to Trams-Priority Active Signal Control

Uniformity of Markov Elements in Deep Reinforcement Learning for Traffic Signal Control

Deep Reinforcement Learning Method for POMDP Based Tram Signal Priority

A Novel Framework Combining MPC and Deep Reinforcement Learning With Application to Freeway Traffic Control

Managing Mixed Traffic at Signalized Intersections: an Adaptive Signal Control and CAV Coordination System Based on Deep Reinforcement Learning.

Deep Reinforcement Learning for Intersection Signal Control Considering Pedestrian Behavior

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Smarter and Safer Traffic Signal Controlling Via Deep Reinforcement Learning

DRL-based adaptive signal control for bus priority service under connected vehicle environment

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Transit Signal Priority under Connected Vehicle Environment: Deep Reinforcement Learning Approach

A Novel Traffic Signal Split Approach Based on Explicit Model Predictive Control

Transit Signal Priority Strategy with Heterogeneous Graph-Based Deep Reinforcement Learning for Autonomous Public Transit Vehicles

Low Carbon City Traffic Signal Control Based on Deep Reinforcement Learning

Decentralized Deep Reinforcement Learning for Network Level Traffic Signal Control

Multi-hop Upstream Preemptive Traffic Signal Control with Deep Reinforcement Learning

Human-centric multimodal deep (HMD) traffic signal control

Mitigating Action Hysteresis in Traffic Signal Control with Traffic Predictive Reinforcement Learning

Traffic Signal Control Optimization Based on Neural Network in the Framework of Model Predictive Control

Deep Q-Learning Network Model for Optimizing Transit Bus Priority at Multiphase Traffic Signal Controlled Intersection