Abstract:Deep reinforcement learning (DRL) has been proven as a powerful approach for robot navigation over the past few years. DRL-based navigation does not require the pre-construction of a map, instead, high-performance navigation skills can be learned from trial-and-error experiences. However, recent DRL-based approaches mostly focus on a fixed navigation target. It is noted that when navigating to a moving target without maps, the performance of the standard RL structure drops dramatically on both the success rate and path efficiency. To address the mapless navigation problem with moving target, the predictive hierarchical DRL (pH-DRL) framework is proposed by integrating the long-term trajectory prediction to provide a cost-effective solution. In the proposed framework, the lower-level policy of the RL agent learns robot control actions to a specified goal, and the higher-level policy learns to make long-range planning of shorter navigation routes by sufficiently exploiting the predicted trajectories. By means of making decisions over two level of policies, the pH-DRL framework is robust to the unavoidable errors in long-term predictions. With the application of deep deterministic policy gradient (DDPG) for policy optimization, the pH-DDPG algorithm is developed based on the pH-DRL structure. Finally, through comparative experiments on the Gazebo simulator with several variants of the DDPG algorithm, the results demonstrate that the pH-DDPG outperforms other algorithms and achieves a high success rate and efficiency even though the target moves fast and randomly.

Predictive reinforcement learning: map-less navigation method for mobile robot

Predictive Hierarchical Reinforcement Learning for Path-Efficient Mapless Navigation with Moving Target.

Robot Localization and Navigation through Predictive Processing using LiDAR

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Probabilistic Roadmap With Self-Learning For Path Planning Of A Mobile Robot In A Dynamic And Unstructured Environment

On Reward Shaping for Mobile Robot Navigation: A Reinforcement Learning and SLAM Based Approach

Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot

Virtual-to-real Deep Reinforcement Learning: Continuous Control of Mobile Robots for Mapless Navigation

Deep Reinforcement Learning Based Mobile Robot Navigation Using Sensor Fusion

Reinforcement Learning for Navigation of Mobile Robot with LiDAR

Intelligent mobile robot navigation in unknown and complex environment using reinforcement learning technique

Heuristic Dense Reward Shaping for Learning-Based Map-Free Navigation of Industrial Automatic Mobile Robots

Learning to Navigate in Indoor Environments: from Memorizing to Reasoning

End-to-End Navigation Strategy with Deep Reinforcement Learning for Mobile Robots

Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation

Mapless mobile robot navigation at the edge using self-supervised cognitive map learners

A Mapless Navigation Method Based on Reinforcement Learning and Local Obstacle Map

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer

Deep-Reinforcement-Learning-Based Semantic Navigation of Mobile Robots in Dynamic Environments

Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation