Abstract:Human drivers have excellent perception and reaction abilities in complex environments such as dangerous highways, busy intersections, and harsh weather conditions. To achieve human-level driving performance, autonomous driving systems require powerful environmental perception systems and the ability to make accurate decisions in difficult situations, enabling vehicles to maintain smooth driving. However, making decisions based on visual perception is still a daunting challenge for autonomous vehicles, also current end-to-end networks and modular frameworks have limitations in effectively addressing perception, decision-making, and control, such as a lack of interpretability and weak generalization ability in complex environments. This paper proposes an elaborate modular pipeline for autonomous driving that effectively integrates semantic perception information, multi-level decision tasks, and control modules. The decision-making module comprehensively considers high-level maneuver selection and low-level motion control in both horizontal and vertical directions. The proposed MP framework is trained end-to-end by a novel hierarchical reinforcement learning method with a new action sampling mechanism. To adapt to the experimental scenarios, we use the CARLA simulation platform to collect data to evaluate the proposed autonomous driving framework and its new training method, considering various environmental factors such as sunny, dusk, and rainy weather. The results show that the framework exhibits smooth and effective driving strategies in different environments and can converge quickly and stably. The method improves learning efficiency and reduces unnecessary coupling and error propagation. Overall, the proposed framework and training method provide new ideas for improving existing autonomous driving systems.

Hierarchical framework integrating rapidly-exploring random tree with deep reinforcement learning for autonomous vehicle

A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Deep Reinforcement Learning framework for Autonomous Driving

Vision-Based Autonomous Driving: A Hierarchical Reinforcement Learning Approach

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

Autonomous Motion Decision-making based on Deep Reinforcement Learning for Autonomous Driving

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

A Hierarchical Imitation Learning-based Decision Framework for Autonomous Driving

Autonomous Highway Driving using Deep Reinforcement Learning

Task-Driven Autonomous Driving: Balanced Strategies Integrating Curriculum Reinforcement Learning and Residual Policy

Autonomous Driving in the Uncertain Traffic——a Deep Reinforcement Learning Approach

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

Towards Robust Decision-Making for Autonomous Driving on Highway

Reinforcement Learning Based Trajectory Planning for Autonomous Vehicles

Deep Reinforcement Learning with Intervention Module for Autonomous Driving.

Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning