Abstract:Mobile robots are playing an increasingly significant role in social life and industrial production, such as searching and rescuing robots, autonomous exploration of sweeping robots, and so on. Improving the accuracy of autonomous navigation of mobile robots is a hot issue to be solved. However, traditional navigation methods are unable to realize crash-free navigation in an environment with dynamic obstacles, more and more scholars are gradually using autonomous navigation based on deep reinforcement learning (DRL) to replace overly conservative traditional methods. But on the other hand, DRL's training time is too long, and the lack of long-term memory easily leads the robot to a dead end, which makes its application in the actual scene more difficult. To shorten training time and prevent mobile robots from getting stuck and spinning around, we design a new robot autonomous navigation framework which combines the traditional global planning and the local planning based on DRL. Therefore, the entire navigation process can be transformed into first using traditional navigation algorithms to find the global path, then searching for several high-value landmarks on the global path, and then using the DRL algorithm to move the mobile robot toward the designated landmarks to complete the final navigation, which makes the robot training difficulty greatly reduced. Furthermore, in order to improve the lack of long-term memory in deep reinforcement learning, we design a feature extraction network containing memory modules to preserve the long-term dependence of input features. Through comparing our methods with traditional navigation methods and reinforcement learning based on end-to-end depth navigation methods, it shows that while the number of dynamic obstacles is large and obstacles are rapidly moving, our proposed method is, on average, 20% better than the second ranked method in navigation efficiency (navigation time and navigation paths' length), 34% better than the second ranked method in safety (collision times), 26.6% higher than the second ranked method in success rate, and shows strong robustness.

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

Improved SLAM and Motor Imagery Based Navigation Control of a Mobile Robot

Robot Navigation with Map-Based Deep Reinforcement Learning

Vision-based mobile robot navigation through deep convolutional neural networks and end-to-end learning

Learning to Navigate: Exploiting Deep Networks to Inform Sample-Based Planning During Vision-Based Navigation

A Soft Actor-Critic Deep Reinforcement-Learning-Based Robot Navigation Method Using LiDAR

End-to-end Autonomous Vehicle Navigation Control Method Guided by the Dynamic Window Approach

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Collision-Free Robot Navigation in Crowded Environments using Learning based Convex Model Predictive Control

Deep Local Trajectory Replanning and Control for Robot Navigation

Virtual-to-real Deep Reinforcement Learning: Continuous Control of Mobile Robots for Mapless Navigation

Deep reinforcement learning-aided autonomous navigation with landmark generators

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

End-to-End Navigation in Unknown Environments using Neural Networks

An End-to-end Auto-driving Method Based on 3D Lidar

The Impact of LiDAR Configuration on Goal-Based Navigation within a Deep Reinforcement Learning Framework

Model-free Neural Lyapunov Control for Safe Robot Navigation

Learning Social Navigation from Demonstrations with Deep Neural Networks

Learning to Navigate for Mobile Robot with Continual Reinforcement Learning

Learning to Navigate in Indoor Environments: from Memorizing to Reasoning

Spatiotemporal Attention Enhances Lidar-Based Robot Navigation in Dynamic Environments