Abstract:Connected and automated vehicles (CAVs) have recently gained prominence in traffic research due to advances in communication technology and autonomous driving. Various longitudinal control strategies for CAVs have been developed to enhance traffic efficiency, stability, and safety in mixed-autonomy scenarios. Deep reinforcement learning (DRL) is one promising strategy for mixed-autonomy platoon control, thanks to its capability of managing complex scenarios in real time after sufficient offline training. However, there are three research gaps for DRL-based mixed-autonomy platoon control: (i) the lack of theoretical collision-free guarantees, (ii) the widely adopted but impractical assumption of skilled and rational drivers who will not collide with preceding vehicles, and (iii) the strong assumption of a known human driver model. To address these research gaps, we propose a safe DRL-based controller that can provide a system-level safety guarantee for mixed-autonomy platoon control. First, we combine control barrier function (CBF)-based safety constraints and DRL via a quadratic programming (QP)-based differentiable neural network layer to provide theoretical safety guarantees. Second, we incorporate system-level safety constraints into our proposed method to account for the safety of both CAVs and the following HDVs to address the potential collisions due to irrational human driving behavior. Third, we devise a learning-based system identification approach to estimate the unknown human car-following behavior in the real system. Simulation results demonstrate that our proposed method effectively ensures CAV safety and improves HDV safety in mixed platoon environments while simultaneously enhancing traffic capacity and string stability.

Collision-Free Path Planning for Multiple Drones Based on Safe Reinforcement Learning

Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning

Energy-Efficient Online Path Planning of Multiple Drones Using Reinforcement Learning

Criticality-Guided Deep Reinforcement Learning for Motion Planning

A RDA-Based Deep Reinforcement Learning Approach for Autonomous Motion Planning of UAV in Dynamic Unknown Environments

A Hybrid Human-in-the-Loop Deep Reinforcement Learning Method for UAV Motion Planning for Long Trajectories with Unpredictable Obstacles

Safe Multiagent Motion Planning Under Uncertainty for Drones Using Filtered Reinforcement Learning

Safe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

A Reinforcement Learning Based Motion Planner for Quadrotor Autonomous Flight in Dense Environment

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Improved Robot Path Planning Method Based on Deep Reinforcement Learning

Safety-guided Deep Reinforcement Learning for Path Planning of Autonomous Mobile Robots

A UAV Path Planning Method Based on Deep Reinforcement Learning

Collision Avoidance and Navigation for a Quadrotor Swarm Using End-to-end Deep Reinforcement Learning

Mapless Path Planning of Multi-robot Systems in Complex Environments Via Deep Reinforcement Learning

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments

Safe Reinforcement Learning Using Black-Box Reachability Analysis

3M-RL: Multi-Resolution, Multi-Agent, Mean-Field Reinforcement Learning for Autonomous UAV Routing

Shielded Planning Guided Data-Efficient and Safe Reinforcement Learning