Abstract:High-speed cruising scenarios with mixed traffic greatly challenge the road safety of autonomous vehicles (AVs). Unlike existing works that only look at fundamental modules in isolation, this work enhances AV safety in mixed-traffic high-speed cruising scenarios by proposing an integrated framework that synthesizes three fundamental modules, i.e., behavioral decision-making, path-planning, and motion-control modules. Considering that the integrated framework would increase the system complexity, a bootstrapped deep Q-Network (DQN) is employed to enhance the deep exploration of the reinforcement learning method and achieve adaptive decision making of AVs. Moreover, to make AV behavior understandable by surrounding HDVs to prevent unexpected operations caused by misinterpretations, we derive an inverse reinforcement learning (IRL) approach to learn the reward function of skilled drivers for the path planning of lane-changing maneuvers. Such a design enables AVs to achieve a human-like tradeoff between multi-performance requirements. Simulations demonstrate that the proposed integrated framework can guide AVs to take safe actions while guaranteeing high-speed cruising performance.

What problem does this paper attempt to address?

This paper aims to address the safety issues of autonomous vehicles (AVs) during high-speed driving. In mixed traffic environments, where AVs coexist with human-driven vehicles (HDVs), the safety of AVs faces challenges. Existing research usually focuses on improving individual modules such as decision-making, path planning, and motion control, while this paper proposes an integrated framework that combines these three modules to enhance the safety of AVs in complex traffic situations. The paper adopts the method of deep reinforcement learning (DQN) to strengthen exploration ability and achieve adaptive decision-making. In order to make the behavior of AVs understandable to surrounding HDVs and prevent accidents caused by misunderstandings, the paper also uses inverse reinforcement learning (IRL) to learn the reward function of skilled drivers, providing a basis for lane changing path planning and enabling AVs to achieve human-like trade-offs in multiple performance aspects. Simulation results demonstrate that the proposed integrated framework can guide AVs to take safe actions while ensuring high-speed driving performance. However, existing integrated frameworks pay little attention to the motion control module or only treat it as a simplified dynamics model, which may lead to infeasible planned paths or behavioral decisions, especially in high-speed driving scenarios. Therefore, the paper emphasizes the importance of incorporating the motion control module into the integrated framework. Furthermore, although safety has been enhanced from a technical perspective, human drivers may not understand the unexpected decisions made by AVs, which may lead to unnecessary risks. By making the behavior of AVs closer to human behavior, the interpretability of their actions can be improved, thereby enhancing compatibility and trust with HDVs. The main contributions of this paper include: 1) proposing an integrated framework that combines decision-making, path planning, and motion control modules to enhance the safety of AVs during high-speed cruising; 2) designing an IRL-based method to learn the reward function of skilled drivers, generating human-like paths for lane changing path planning and balancing multiple performance requirements.

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Reinforcement Learning in V2I Communication Assisted Autonomous Driving

Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness

Multi-Level Objective Control of AVs at a Saturated Signalized Intersection with Multi-Agent Deep Reinforcement Learning Approach

Autonomous Highway Driving using Deep Reinforcement Learning

Automated Vehicle’s Behavior Decision Making Using Deep Reinforcement Learning and High-Fidelity Simulation Environment

A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

A Deep Reinforcement Learning Approach for Optimized Speed Planning of Connected and Autonomous Vehicles

Safe, Efficient, and Comfortable Autonomous Driving Based on Cooperative Vehicle Infrastructure System

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

A Deep Reinforcement Learning Based Distributed Control Strategy for Connected Automated Vehicles in Mixed Traffic Platoon

Reinforcement learning-based adaptive speed controllers in mixed autonomy condition

Task-Driven Autonomous Driving: Balanced Strategies Integrating Curriculum Reinforcement Learning and Residual Policy

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Variable Speed Limit Control for Mixed Traffic Flow on Highways Based on Deep-Reinforcement Learning

Operational Characteristics of Mixed-Autonomy Traffic Flow on the Freeway with On- and Off-Ramps and Weaving Sections: an RL-Based Approach

Transferable Deep Reinforcement Learning Framework for Autonomous Vehicles With Joint Radar-Data Communications

Longitudinal control of automated vehicles: A novel approach by integrating deep reinforcement learning with intelligent driver model

Connected Automated Vehicle Cooperative Control with a Deep Reinforcement Learning Approach in a Mixed Traffic Environment