Abstract:Managing the mixed traffic involving connected and autonomous vehicles (CAVs) and human-driven vehicles (HVs) at a signalized intersection has become a concern of researchers. However, the performances of most existing control methods are limited, especially when CAV penetration rate is low, since they fail to make a better trade-off between safety and operational efficiency for both CAVs and HVs. To this end, this study proposes a deep reinforcement learning (DRL) powered control system for the mixed traffic at signalized intersections, which aims to optimize operational efficiency of both CAVs and HVs while assuring safety and reducing interference on HVs’ driving habits. The system adopts an adaptive traffic signal control strategy and an efficient CAV control policy with a passing rule proposed as a link in between. The traffic signal control strategy allows traffic light to adaptively adjust its phase and duration based on real-time traffic information, while the CAV control policy permits the CAVs meeting certain safety constraints to form platoons and pass through the intersection in a coordinated manner regardless of traffic signals. As an efficient DRL algorithm, Deep Q-Network (DQN) is adopted to adaptively control the signals and implement CAV coordination. The proposed system is examined on Simulation of Urban Mobility (SUMO), given different CAV penetration rates and traffic conditions. It is found that the proposed system not only outperforms the state-of-the-art control methods on reducing travel time and fuel consumption under low CAV penetration rate, but also enlarges its advantages with the increase of CAV penetration rate. In certain traffic scenarios, the proposed system can even achieve a maximum reduction of travel time by 37.33% and fuel consumption by 15.95%, in comparison to the existing method with the best performance. Besides, to some extent, the comparisons between the performances of CAVs and HVs demonstrate certain benefits of introducing CAVs into the mixed traffic.

DeeP-LCC: Data-EnablEd Predictive Leading Cruise Control in Mixed Traffic Flow

Data-Driven Predictive Control for Connected and Autonomous Vehicles in Mixed Traffic

Smoothing Mixed Traffic with Robust Data-driven Predictive Control for Connected and Autonomous Vehicles

Distributed data-driven predictive control for cooperatively smoothing mixed traffic flow

Implementation and Experimental Validation of Data-Driven Predictive Control for Dissipating Stop-and-Go Waves in Mixed Traffic

Decentralized Robust Data-driven Predictive Control for Smoothing Mixed Traffic Flow

Robust Data-EnablEd Predictive Leading Cruise Control via Reachability Analysis

Physics-Augmented Data-EnablEd Predictive Control for Eco-driving of Mixed Traffic Considering Diverse Human Behaviors

A Safety-Enhanced Eco-Driving Strategy for Connected and Autonomous Vehicles: A Hierarchical and Distributed Framework

Robust Data-Driven Predictive Control for Mixed Platoons under Noise and Attacks

Leading Cruise Control in Mixed Traffic Flow: System Modeling, Controllability, and String Stability

Privacy-Preserving Data-Enabled Predictive Leading Cruise Control in Mixed Traffic

Adaptive Leading Cruise Control in Mixed Traffic Considering Human Behavioral Diversity

Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

Managing Mixed Traffic at Signalized Intersections: an Adaptive Signal Control and CAV Coordination System Based on Deep Reinforcement Learning.

Altruistic cooperative adaptive cruise control of mixed traffic platoon based on deep reinforcement learning

Model Predictive Adaptive Cruise Control of Intelligent Electric Vehicles Based on Deep Reinforcement Learning Algorithm FWOR Driver Characteristics

Proximal Policy Optimization-Based Driving Control Strategy of Connected Cruise Vehicle Platoons to Improve Traffic Efficiency and Safety

Bi-Level Control of Weaving Sections in Mixed Traffic Environments with Connected and Automated Vehicles

Cooperative adaptive cruise control system for electric vehicles through a predictive deep reinforcement learning approach

Improving Traffic Operation of Bottleneck in a Connected and Automated Vehicles Environment: An Integrated Lane-Level Control Method