Abstract:Mobile robots are playing an increasingly significant role in social life and industrial production, such as searching and rescuing robots, autonomous exploration of sweeping robots, and so on. Improving the accuracy of autonomous navigation of mobile robots is a hot issue to be solved. However, traditional navigation methods are unable to realize crash-free navigation in an environment with dynamic obstacles, more and more scholars are gradually using autonomous navigation based on deep reinforcement learning (DRL) to replace overly conservative traditional methods. But on the other hand, DRL's training time is too long, and the lack of long-term memory easily leads the robot to a dead end, which makes its application in the actual scene more difficult. To shorten training time and prevent mobile robots from getting stuck and spinning around, we design a new robot autonomous navigation framework which combines the traditional global planning and the local planning based on DRL. Therefore, the entire navigation process can be transformed into first using traditional navigation algorithms to find the global path, then searching for several high-value landmarks on the global path, and then using the DRL algorithm to move the mobile robot toward the designated landmarks to complete the final navigation, which makes the robot training difficulty greatly reduced. Furthermore, in order to improve the lack of long-term memory in deep reinforcement learning, we design a feature extraction network containing memory modules to preserve the long-term dependence of input features. Through comparing our methods with traditional navigation methods and reinforcement learning based on end-to-end depth navigation methods, it shows that while the number of dynamic obstacles is large and obstacles are rapidly moving, our proposed method is, on average, 20% better than the second ranked method in navigation efficiency (navigation time and navigation paths' length), 34% better than the second ranked method in safety (collision times), 26.6% higher than the second ranked method in success rate, and shows strong robustness.

Deep reinforcement learning navigation via decision transformer in autonomous driving

Decision Making for Autonomous Driving Via Multimodal Transformer and Deep Reinforcement Learning * .

Goal-Guided Transformer-Enabled Reinforcement Learning for Efficient Autonomous Navigation

Augmenting Reinforcement Learning with Transformer-based Scene Representation Learning for Decision-making of Autonomous Driving

SPformer: A Transformer Based DRL Decision Making Method for Connected Automated Vehicles

Deductive Reinforcement Learning for Visual Autonomous Urban Driving Navigation.

Rethinking Decision Transformer via Hierarchical Reinforcement Learning

Towards Autonomous Driving Decision by Combining Self-attention and Deep Reinforcement Learning.

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning

Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environment

Autonomous Motion Decision-making based on Deep Reinforcement Learning for Autonomous Driving

Lane Change Strategies for Autonomous Vehicles: A Deep Reinforcement Learning Approach Based on Transformer

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Decision-making for Autonomous Vehicles on Highway: Deep Reinforcement Learning with Continuous Action Horizon

Autonomous Navigation for Cellular-Connected UAV in Highly Dynamic Environments: A Deep Reinforcement Learning Approach

Sequence Decision Transformer for Adaptive Traffic Signal Control

Pre-trained Transformer-Enabled Strategies with Human-Guided Fine-Tuning for End-to-end Navigation of Autonomous Vehicles

Deep reinforcement learning-aided autonomous navigation with landmark generators

An Intelligent Maneuver Decision-Making Approach for Air Combat Based on Deep Reinforcement Learning and Transformer Networks

Progress and Challenges in Applying Deep Reinforcement Learning to Intelligent Navigation

Human-Guided Reinforcement Learning With Sim-to-Real Transfer for Autonomous Navigation