Abstract:Managing the mixed traffic involving connected and autonomous vehicles (CAVs) and human-driven vehicles (HVs) at a signalized intersection has become a concern of researchers. However, the performances of most existing control methods are limited, especially when CAV penetration rate is low, since they fail to make a better trade-off between safety and operational efficiency for both CAVs and HVs. To this end, this study proposes a deep reinforcement learning (DRL) powered control system for the mixed traffic at signalized intersections, which aims to optimize operational efficiency of both CAVs and HVs while assuring safety and reducing interference on HVs’ driving habits. The system adopts an adaptive traffic signal control strategy and an efficient CAV control policy with a passing rule proposed as a link in between. The traffic signal control strategy allows traffic light to adaptively adjust its phase and duration based on real-time traffic information, while the CAV control policy permits the CAVs meeting certain safety constraints to form platoons and pass through the intersection in a coordinated manner regardless of traffic signals. As an efficient DRL algorithm, Deep Q-Network (DQN) is adopted to adaptively control the signals and implement CAV coordination. The proposed system is examined on Simulation of Urban Mobility (SUMO), given different CAV penetration rates and traffic conditions. It is found that the proposed system not only outperforms the state-of-the-art control methods on reducing travel time and fuel consumption under low CAV penetration rate, but also enlarges its advantages with the increase of CAV penetration rate. In certain traffic scenarios, the proposed system can even achieve a maximum reduction of travel time by 37.33% and fuel consumption by 15.95%, in comparison to the existing method with the best performance. Besides, to some extent, the comparisons between the performances of CAVs and HVs demonstrate certain benefits of introducing CAVs into the mixed traffic.

Intersection Self-Organization Control for Connected Autonomous Vehicles Based on Traffic Strategy Learning Algorithm

Traffic Scheduling and Control in Fully Connected and Automated Networks

An Advanced Control Strategy for Connected Autonomous Vehicles Based on Micro Simulation Models at Multiple Intersections

Traffic Signal Coordination Control for Arterials with Dedicated CAV Lanes

Cooperation Method of Connected and Automated Vehicles at Unsignalized Intersections: Lane Changing and Arrival Scheduling

A Discrete Control Method for the Unsignalized Intersection Based on Cooperative Grouping

Unsignalized Intersection Management Strategy for Mixed Autonomy Traffic Streams

Self-Learned Intelligence for Integrated Decision and Control of Automated Vehicles at Signalized Intersections

Development of an Efficient Driving Strategy for Connected and Automated Vehicles at Signalized Intersections: A Reinforcement Learning Approach

A Novel Coordination Mechanism for Connected and Automated Vehicles in the Multi-Intersection Road Network

Collision-Free Cooperative Motion Planning and Decision-Making for Connected and Automated Vehicles at Unsignalized Intersections

Courteous Behavior of Automated Vehicles at Unsignalized Intersections Via Reinforcement Learning

Coupling Control of Traffic Signal and Entry Lane at Isolated Intersections Under the Mixed-Autonomy Traffic Environment

Multi-lane Unsignalized Intersection Cooperation with Flexible Lane Direction based on Multi-vehicle Formation Control

Vehicular intelligent collaborative intersection driving decision algorithm in Internet of Vehicles

Cooperative Schedule-Driven Intersection Control with Connected and Autonomous Vehicles

Cooperative Roundabout Control Strategy for Connected and Autonomous Vehicles

A Hybrid Intersection Control Strategy for CAVs under Fluctuating Traffic Demands: A Value Approximation Approach

Managing Mixed Traffic at Signalized Intersections: an Adaptive Signal Control and CAV Coordination System Based on Deep Reinforcement Learning.

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

An Intersection Game-Theory-Based Traffic Control Algorithm in a Connected Vehicle Environment