Abstract:Managing the mixed traffic involving connected and autonomous vehicles (CAVs) and human-driven vehicles (HVs) at a signalized intersection has become a concern of researchers. However, the performances of most existing control methods are limited, especially when CAV penetration rate is low, since they fail to make a better trade-off between safety and operational efficiency for both CAVs and HVs. To this end, this study proposes a deep reinforcement learning (DRL) powered control system for the mixed traffic at signalized intersections, which aims to optimize operational efficiency of both CAVs and HVs while assuring safety and reducing interference on HVs’ driving habits. The system adopts an adaptive traffic signal control strategy and an efficient CAV control policy with a passing rule proposed as a link in between. The traffic signal control strategy allows traffic light to adaptively adjust its phase and duration based on real-time traffic information, while the CAV control policy permits the CAVs meeting certain safety constraints to form platoons and pass through the intersection in a coordinated manner regardless of traffic signals. As an efficient DRL algorithm, Deep Q-Network (DQN) is adopted to adaptively control the signals and implement CAV coordination. The proposed system is examined on Simulation of Urban Mobility (SUMO), given different CAV penetration rates and traffic conditions. It is found that the proposed system not only outperforms the state-of-the-art control methods on reducing travel time and fuel consumption under low CAV penetration rate, but also enlarges its advantages with the increase of CAV penetration rate. In certain traffic scenarios, the proposed system can even achieve a maximum reduction of travel time by 37.33% and fuel consumption by 15.95%, in comparison to the existing method with the best performance. Besides, to some extent, the comparisons between the performances of CAVs and HVs demonstrate certain benefits of introducing CAVs into the mixed traffic.

Deep Reinforcement Learning for Pedestrian Collision Avoidance and Human-Machine Cooperative Driving

Deep-Reinforcement-Learning-Based Collision Avoidance of Autonomous Driving System for Vulnerable Road User Safety

Hierarchical Reinforcement Learning with Successor Representation for Intelligent Vehicle Collision Avoidance of Dynamic Pedestrian

Deep Reinforcement Learning for Human-Like Driving Policies in Collision Avoidance Tasks of Self-Driving Cars

Deep Reinforcement Learning for Advanced Longitudinal Control and Collision Avoidance in High-Risk Driving Scenarios

Stochastic Pedestrian Avoidance for Autonomous Vehicles Using Hybrid Reinforcement Learning

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

A Robust Active Safety Enhancement Strategy With Learning Mechanism in Vehicular Networks

A Real-Time Collision Prediction Mechanism With Deep Learning for Intelligent Transportation System

Accelerated Sim-to-Real Deep Reinforcement Learning: Learning Collision Avoidance from Human Player

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Human-Like Control for Automated Vehicles and Avoiding "vehicle Face-Off" in Unprotected Left Turn Scenarios.

Driver Intent-Based Intersection Autonomous Driving Collision Avoidance Reinforcement Learning Algorithm

Managing Mixed Traffic at Signalized Intersections: an Adaptive Signal Control and CAV Coordination System Based on Deep Reinforcement Learning.

Cognitive Level-$k$ Meta-Learning for Safe and Pedestrian-Aware Autonomous Driving

Reinforce Learning-Based Collision Avoidance in Network Assisted Automated Driving

Human-in-the-Loop Deep Reinforcement Learning with Application to Autonomous Driving

An Active Safety Control Method of Collision Avoidance for Intelligent Connected Vehicle Based on Driving Risk Perception

Deep Reinforcement Learning for Intersection Signal Control Considering Pedestrian Behavior

Application of Hybrid Deep Reinforcement Learning for Managing Connected Cars at Pedestrian Crossings: Challenges and Research Directions

Modeling Interactions of Autonomous Vehicles and Pedestrians with Deep Multi-Agent Reinforcement Learning for Collision Avoidance