Abstract:Connected and automated vehicles (CAVs) have recently gained prominence in traffic research due to advances in communication technology and autonomous driving. Various longitudinal control strategies for CAVs have been developed to enhance traffic efficiency, stability, and safety in mixed-autonomy scenarios. Deep reinforcement learning (DRL) is one promising strategy for mixed-autonomy platoon control, thanks to its capability of managing complex scenarios in real time after sufficient offline training. However, there are three research gaps for DRL-based mixed-autonomy platoon control: (i) the lack of theoretical collision-free guarantees, (ii) the widely adopted but impractical assumption of skilled and rational drivers who will not collide with preceding vehicles, and (iii) the strong assumption of a known human driver model. To address these research gaps, we propose a safe DRL-based controller that can provide a system-level safety guarantee for mixed-autonomy platoon control. First, we combine control barrier function (CBF)-based safety constraints and DRL via a quadratic programming (QP)-based differentiable neural network layer to provide theoretical safety guarantees. Second, we incorporate system-level safety constraints into our proposed method to account for the safety of both CAVs and the following HDVs to address the potential collisions due to irrational human driving behavior. Third, we devise a learning-based system identification approach to estimate the unknown human car-following behavior in the real system. Simulation results demonstrate that our proposed method effectively ensures CAV safety and improves HDV safety in mixed platoon environments while simultaneously enhancing traffic capacity and string stability.

Reliable safety decision-making for autonomous vehicles: a safety assurance reinforcement learning

Trustworthy safety improvement for autonomous driving using reinforcement learning

A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning

Safe Decision-making for Lane-change of Autonomous Vehicles via Human Demonstration-aided Reinforcement Learning

Cautious Adaptation For Reinforcement Learning in Safety-Critical Settings

Autonomous Highway Driving using Deep Reinforcement Learning

SECRM-2D: RL-Based Efficient and Comfortable Route-Following Autonomous Driving with Analytic Safety Guarantees

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

Towards Robust Decision-Making for Autonomous Highway Driving Based on Safe Reinforcement Learning

Reinforcement Learning Based Safe Decision Making for Highway Autonomous Driving

Safe-State Enhancement Method for Autonomous Driving Via Direct Hierarchical Reinforcement Learning.

Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Emergency Collision Avoidance Decision-making for Autonomous Vehicles: A Model-based Reinforcement Learning Approach

Autonomous highway driving using reinforcement learning with safety check system based on time-to-collision

Decision Making of Autonomous Vehicles in Lane Change Scenarios: Deep Reinforcement Learning Approaches with Risk Awareness

Towards Robust Decision-Making for Autonomous Driving on Highway

Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change

A Behavior Decision Method Based on Reinforcement Learning for Autonomous Driving

Confidence-Aware Reinforcement Learning for Self-Driving Cars

A Decision-Making Strategy for Vehicle Autonomous Braking in Emergency via Deep Reinforcement Learning