Abstract:Connected and automated vehicles (CAVs) have recently gained prominence in traffic research due to advances in communication technology and autonomous driving. Various longitudinal control strategies for CAVs have been developed to enhance traffic efficiency, stability, and safety in mixed-autonomy scenarios. Deep reinforcement learning (DRL) is one promising strategy for mixed-autonomy platoon control, thanks to its capability of managing complex scenarios in real time after sufficient offline training. However, there are three research gaps for DRL-based mixed-autonomy platoon control: (i) the lack of theoretical collision-free guarantees, (ii) the widely adopted but impractical assumption of skilled and rational drivers who will not collide with preceding vehicles, and (iii) the strong assumption of a known human driver model. To address these research gaps, we propose a safe DRL-based controller that can provide a system-level safety guarantee for mixed-autonomy platoon control. First, we combine control barrier function (CBF)-based safety constraints and DRL via a quadratic programming (QP)-based differentiable neural network layer to provide theoretical safety guarantees. Second, we incorporate system-level safety constraints into our proposed method to account for the safety of both CAVs and the following HDVs to address the potential collisions due to irrational human driving behavior. Third, we devise a learning-based system identification approach to estimate the unknown human car-following behavior in the real system. Simulation results demonstrate that our proposed method effectively ensures CAV safety and improves HDV safety in mixed platoon environments while simultaneously enhancing traffic capacity and string stability.

Reinforcement Learning in V2I Communication Assisted Autonomous Driving

Reinforcement Learning for Joint V2I Network Selection and Autonomous Driving Policies

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness

V2X-Lead: LiDAR-based End-to-End Autonomous Driving with Vehicle-to-Everything Communication Integration

Multi-agent Reinforcement Learning Based Resource Allocation for Vehicular Networks.

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

A Novel Reinforcement Learning Method for Autonomous Driving with Intermittent Vehicle-to-Everything (V2X) Communications

Hybrid LLM-DDQN based Joint Optimization of V2I Communication and Autonomous Driving

Dueling Deep Q Network for Highway Decision Making in Autonomous Vehicles: A Case Study

A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning

Deep Reinforcement Learning-aided Transmission Design for Energy-efficient Link Optimization in Vehicular Communications

Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning

Jointly Learning V2X Communication and Platoon Control with Deep Reinforcement Learning

Autonomous Highway Driving using Deep Reinforcement Learning

Deep Reinforcement Learning Based Intelligent Resource Allocation in Hybrid Vehicle Scenario

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

Enhancing the Minimum Awareness Failure Distance in V2X Communications: A Deep Reinforcement Learning Approach

Hybrid Reinforcement Learning-Based Eco-Driving Strategy for Connected and Automated Vehicles at Signalized Intersections