Abstract:With the development of machine perception and multimodal information decision-making techniques, autonomous driving technology has become a crucial area of advancement in the transportation industry. The optimization of vehicle navigation, path planning, and obstacle avoidance tasks is of paramount importance. In this study, we explore the use of attention mechanisms in a end-to-end architecture for optimizing obstacle avoidance and path planning in autonomous driving vehicles. We position our research within the broader context of robotics, emphasizing the fusion of information and decision-making capabilities. The introduction of attention mechanisms enables vehicles to perceive the environment more accurately by focusing on important information and making informed decisions in complex scenarios. By inputting multimodal information, such as images and LiDAR data, into the attention mechanism module, the system can automatically learn and weigh crucial environmental features, thereby placing greater emphasis on key information during obstacle avoidance decisions. Additionally, we leverage the end-to-end architecture and draw from classical theories and algorithms in the field of robotics to enhance the perception and decision-making abilities of autonomous driving vehicles. Furthermore, we address the optimization of path planning using attention mechanisms. We transform the vehicle's navigation task into a sequential decision-making problem and employ LSTM (Long Short-Term Memory) models to handle dynamic navigation in varying environments. By applying attention mechanisms to weigh key points along the navigation path, the vehicle can flexibly select the optimal route and dynamically adjust it based on real-time conditions. Finally, we conducted extensive experimental evaluations and software experiments on the proposed end-to-end architecture on real road datasets. The method effectively avoids obstacles, adheres to traffic rules, and achieves stable, safe, and efficient autonomous driving in diverse road scenarios. This research provides an effective solution for optimizing obstacle avoidance and path planning in the field of autonomous driving. Moreover, it contributes to the advancement and practical applications of multimodal information fusion in navigation, localization, and human-robot interaction.

Perceive, Attend, and Drive: Learning Spatial Attention for Safe Self-Driving

Explaining Autonomous Driving by Learning End-to-End Visual Attention

Brain Inspired Cognitive Model with Attention for Self-Driving Cars

Human Visual Attention Prediction Boosts Learning & Performance of Autonomous Driving Agents

Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations

ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning

Recent advancements in driver's attention prediction

Guiding Attention in End-to-End Driving Models

Enhancing autonomous driving systems with deep learning and spatial channel attention mechanisms: an experimental study

Explaining autonomous driving with visual attention and end-to-end trainable region proposals

STDA: Spatio-Temporal Dual-Encoder Network Incorporating Driver Attention to Predict Driver Behaviors Under Safety-Critical Scenarios

SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation

PilotAttnNet: Multi-modal Attention Network for End-to-End Steering Control.

Visual attention for behavioral cloning in autonomous driving

Multi-task Learning with Attention for End-to-end Autonomous Driving

Multisource Adaption for Driver Attention Prediction in Arbitrary Driving Scenes

Research on obstacle avoidance optimization and path planning of autonomous vehicles based on attention mechanism combined with multimodal information decision-making thoughts of robots

EraW-Net: Enhance-Refine-Align W-Net for Scene-Associated Driver Attention Estimation

Multi-Modal Sensor Fusion-Based Deep Neural Network for End-to-End Autonomous Driving With Scene Understanding