Abstract:Connected and automated vehicles (CAVs) have recently gained prominence in traffic research due to advances in communication technology and autonomous driving. Various longitudinal control strategies for CAVs have been developed to enhance traffic efficiency, stability, and safety in mixed-autonomy scenarios. Deep reinforcement learning (DRL) is one promising strategy for mixed-autonomy platoon control, thanks to its capability of managing complex scenarios in real time after sufficient offline training. However, there are three research gaps for DRL-based mixed-autonomy platoon control: (i) the lack of theoretical collision-free guarantees, (ii) the widely adopted but impractical assumption of skilled and rational drivers who will not collide with preceding vehicles, and (iii) the strong assumption of a known human driver model. To address these research gaps, we propose a safe DRL-based controller that can provide a system-level safety guarantee for mixed-autonomy platoon control. First, we combine control barrier function (CBF)-based safety constraints and DRL via a quadratic programming (QP)-based differentiable neural network layer to provide theoretical safety guarantees. Second, we incorporate system-level safety constraints into our proposed method to account for the safety of both CAVs and the following HDVs to address the potential collisions due to irrational human driving behavior. Third, we devise a learning-based system identification approach to estimate the unknown human car-following behavior in the real system. Simulation results demonstrate that our proposed method effectively ensures CAV safety and improves HDV safety in mixed platoon environments while simultaneously enhancing traffic capacity and string stability.

Attention-based Highway Safety Planner for Autonomous Driving Via Deep Reinforcement Learning

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Highway Decision-Making and Motion Planning for Autonomous Driving via Soft Actor-Critic

Motion Planner with Fixed-Horizon Constrained Reinforcement Learning for Complex Autonomous Driving Scenarios

An efficient planning method based on deep reinforcement learning with hybrid actions for autonomous driving on highway

Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

Towards Safe Motion Planning for Autonomous Driving in Highway

Risk-aware Deep Reinforcement Learning for Decision-making and Planning of Autonomous Vehicles

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning

Safe-State Enhancement Method for Autonomous Driving Via Direct Hierarchical Reinforcement Learning.

Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving

DRL-GAT-SA: Deep reinforcement learning for autonomous driving planning based on graph attention networks and simplex architecture

Hierarchical Reinforcement Learning for Autonomous Decision Making and Motion Planning of Intelligent Vehicles

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

Perceive, Attend, and Drive: Learning Spatial Attention for Safe Self-Driving

HR-Planner: A Hierarchical Highway Tactical Planner Based on Residual Reinforcement Learning

Risk Assessment and Interactive Motion Planning with Visual Occlusion Using Graph Attention Networks and Reinforcement Learning

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework