Abstract:Mobile robots are playing an increasingly significant role in social life and industrial production, such as searching and rescuing robots, autonomous exploration of sweeping robots, and so on. Improving the accuracy of autonomous navigation of mobile robots is a hot issue to be solved. However, traditional navigation methods are unable to realize crash-free navigation in an environment with dynamic obstacles, more and more scholars are gradually using autonomous navigation based on deep reinforcement learning (DRL) to replace overly conservative traditional methods. But on the other hand, DRL's training time is too long, and the lack of long-term memory easily leads the robot to a dead end, which makes its application in the actual scene more difficult. To shorten training time and prevent mobile robots from getting stuck and spinning around, we design a new robot autonomous navigation framework which combines the traditional global planning and the local planning based on DRL. Therefore, the entire navigation process can be transformed into first using traditional navigation algorithms to find the global path, then searching for several high-value landmarks on the global path, and then using the DRL algorithm to move the mobile robot toward the designated landmarks to complete the final navigation, which makes the robot training difficulty greatly reduced. Furthermore, in order to improve the lack of long-term memory in deep reinforcement learning, we design a feature extraction network containing memory modules to preserve the long-term dependence of input features. Through comparing our methods with traditional navigation methods and reinforcement learning based on end-to-end depth navigation methods, it shows that while the number of dynamic obstacles is large and obstacles are rapidly moving, our proposed method is, on average, 20% better than the second ranked method in navigation efficiency (navigation time and navigation paths' length), 34% better than the second ranked method in safety (collision times), 26.6% higher than the second ranked method in success rate, and shows strong robustness.

Spiking Reinforcement Learning with Memory Ability for Mapless Navigation

Predictive Hierarchical Reinforcement Learning for Path-Efficient Mapless Navigation with Moving Target.

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

Navigation in Unknown Dynamic Environments Based on Deep Reinforcement Learning

Cognitive Navigation by Neuro-Inspired Localization, Mapping, and Episodic Memory

Deep reinforcement learning-aided autonomous navigation with landmark generators

MGRL: Graph neural network based inference in a Markov network with reinforcement learning for visual navigation

A Novel Neural Multi-Store Memory Network for Autonomous Visual Navigation in Unknown Environment

Neural Map: Structured Memory for Deep Reinforcement Learning

MeSA-DRL: Memory-Enhanced Deep Reinforcement Learning for Advanced Socially Aware Robot Navigation in Crowded Environments

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer

An Efficient Deep Reinforcement Learning Algorithm for Mapless Navigation with Gap-Guided Switching Strategy

A Memristive Spiking Neural Network Circuit for Bio-inspired Navigation Based on Spatial Cognitive Mechanisms

Mapless mobile robot navigation at the edge using self-supervised cognitive map learners

Hierarchical reinforcement learning for handling sparse rewards in multi-goal navigation

Memory-based soft actor–critic with prioritized experience replay for autonomous navigation

Learning to Navigate in Indoor Environments: from Memorizing to Reasoning

Neuro-Planner: A 3D Visual Navigation Method for MAV With Depth Camera Based on Neuromorphic Reinforcement Learning

D2M2N: Decentralized Differentiable Memory-Enabled Mapping and Navigation for Multiple Robots

Learning With Stochastic Guidance for Robot Navigation