Abstract:Human drivers have excellent perception and reaction abilities in complex environments such as dangerous highways, busy intersections, and harsh weather conditions. To achieve human-level driving performance, autonomous driving systems require powerful environmental perception systems and the ability to make accurate decisions in difficult situations, enabling vehicles to maintain smooth driving. However, making decisions based on visual perception is still a daunting challenge for autonomous vehicles, also current end-to-end networks and modular frameworks have limitations in effectively addressing perception, decision-making, and control, such as a lack of interpretability and weak generalization ability in complex environments. This paper proposes an elaborate modular pipeline for autonomous driving that effectively integrates semantic perception information, multi-level decision tasks, and control modules. The decision-making module comprehensively considers high-level maneuver selection and low-level motion control in both horizontal and vertical directions. The proposed MP framework is trained end-to-end by a novel hierarchical reinforcement learning method with a new action sampling mechanism. To adapt to the experimental scenarios, we use the CARLA simulation platform to collect data to evaluate the proposed autonomous driving framework and its new training method, considering various environmental factors such as sunny, dusk, and rainy weather. The results show that the framework exhibits smooth and effective driving strategies in different environments and can converge quickly and stably. The method improves learning efficiency and reduces unnecessary coupling and error propagation. Overall, the proposed framework and training method provide new ideas for improving existing autonomous driving systems.

A hierarchical perception decision-making framework for autonomous driving

Vision-Based Autonomous Driving: A Hierarchical Reinforcement Learning Approach

A Hierarchical Imitation Learning-based Decision Framework for Autonomous Driving

Learning-Based Hierarchical Decision-Making Framework for Automatic Driving in Incompletely Connected Traffic Scenarios

Decision making framework for autonomous vehicles driving behavior in complex scenarios via hierarchical state machine

Hierarchical Perception Enhancement for Different Levels of Autonomous Driving: A Review

Hierarchical and Decoupled BEV Perception Learning Framework for Autonomous Driving

Multilevel Graph Reinforcement Learning for Consistent Cognitive Decision-making in Heterogeneous Mixed Autonomy

Hierarchical End-to-End Autonomous Driving: Integrating BEV Perception with Deep Reinforcement Learning

Parameterized Decision-making with Multi-modal Perception for Autonomous Driving

Parameterized Decision-Making with Multi-Modality Perception for Autonomous Driving

A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning

Decision-Making Driven by Driver Intelligence and Environment Reasoning for High-Level Autonomous Vehicles: A Survey

Learning a Decision Module by Imitating Driver's Control Behaviors

DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Driving

Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles

Hierarchical framework integrating rapidly-exploring random tree with deep reinforcement learning for autonomous vehicle

Towards Autonomous Driving Decision by Combining Self-attention and Deep Reinforcement Learning.

Hierarchical reinforcement learning for self-driving decision-making without reliance on labelled driving data

Impact-aware Maneuver Decision with Enhanced Perception for Autonomous Vehicle.

Design of a Deep Learning-Based Autonomous Vehicle Environmental Perception and Decision-Making System