Abstract:Mobile robots are playing an increasingly significant role in social life and industrial production, such as searching and rescuing robots, autonomous exploration of sweeping robots, and so on. Improving the accuracy of autonomous navigation of mobile robots is a hot issue to be solved. However, traditional navigation methods are unable to realize crash-free navigation in an environment with dynamic obstacles, more and more scholars are gradually using autonomous navigation based on deep reinforcement learning (DRL) to replace overly conservative traditional methods. But on the other hand, DRL's training time is too long, and the lack of long-term memory easily leads the robot to a dead end, which makes its application in the actual scene more difficult. To shorten training time and prevent mobile robots from getting stuck and spinning around, we design a new robot autonomous navigation framework which combines the traditional global planning and the local planning based on DRL. Therefore, the entire navigation process can be transformed into first using traditional navigation algorithms to find the global path, then searching for several high-value landmarks on the global path, and then using the DRL algorithm to move the mobile robot toward the designated landmarks to complete the final navigation, which makes the robot training difficulty greatly reduced. Furthermore, in order to improve the lack of long-term memory in deep reinforcement learning, we design a feature extraction network containing memory modules to preserve the long-term dependence of input features. Through comparing our methods with traditional navigation methods and reinforcement learning based on end-to-end depth navigation methods, it shows that while the number of dynamic obstacles is large and obstacles are rapidly moving, our proposed method is, on average, 20% better than the second ranked method in navigation efficiency (navigation time and navigation paths' length), 34% better than the second ranked method in safety (collision times), 26.6% higher than the second ranked method in success rate, and shows strong robustness.

Deep SIMBAD: Active Landmark-based Self-localization Using Similarity-based Scene Descriptor

Deep SIMBAD: Active Landmark-based Self-localization Using Ranking -based Scene Descriptor

Domain-invariant NBV Planner for Active Cross-domain Self-localization

A Panoramic Localizer Based on Coarse-to-Fine Descriptors for Navigation Assistance

RINet: Efficient 3D Lidar-Based Place Recognition Using Rotation Invariant Neural Network

Deep Active Localization

Active Visual Localization in Partially Calibrated Environments.

Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigation

Deep Reinforcement Learning for Localizability-Enhanced Navigation in Dynamic Human Environments

Multi-Agent Exploration of an Unknown Sparse Landmark Complex via Deep Reinforcement Learning

Deep reinforcement learning-aided autonomous navigation with landmark generators

PRAM: Place Recognition Anywhere Model for Efficient Visual Localization

Open-World Distributed Robot Self-Localization with Transferable Visual Vocabulary and Both Absolute and Relative Features

Deep introspective SLAM: deep reinforcement learning based approach to avoid tracking failure in visual SLAM

NL-SLAM for OC-VLN: Natural Language Grounded SLAM for Object-Centric VLN

Localizer-to-Mapper Knowledge Transfer: Real-time Diagnosis of Deep SLAM in Everyday Navigation

AnyLoc: Towards Universal Visual Place Recognition

Combining Deep Learning and Model-Based Methods for Robust Real-Time Semantic Landmark Detection

Vision and Language Navigation in the Real World via Online Visual Language Mapping

IVLMap: Instance-Aware Visual Language Grounding for Consumer Robot Navigation

SeqNetVLAD vs PointNetVLAD: Image Sequence vs 3D Point Clouds for Day-Night Place Recognition