Abstract:Learning navigation policies considers the task of training a model that can find collision-free paths for mobile robots, where various Deep Reinforcement Learning (DRL) methods have been applied with promising results. However, the natural reward function for the task is usually sparse, i.e., obtaining a penalty for the collision and a positive reward for arriving the target position, which makes it difficult to learn. In particular, for some complex navigation environments, it is hard to search a collision-free path by the random exploration, which leads to a rather slow learning speed and solutions with poor performance. In this paper, we propose a DRL based approach to train an end-to-end navigation planner, i.e, the policy neural network, that directly translates the local grid map and the relative goal of the robot into its moving actions. To handle the sparse reward problem, we augment the normal extrinsic reward from the environment with intrinsic reward signals measured by random network distillation (RND). In specific, the intrinsic reward is calculated by two different networks from RND, which encourages the agent to explore a state that has not been seen before. The experimental results show that by augmenting the reward function with intrinsic reward signals by RND, solutions with better performance can be learned more efficiently and more stably in our approach. We also deploy the trained model to a real robot, which can perform collision avoidance in navigation tasks without any parameter tuning. A video of our experiments can be found at https://youtu.be/b1GJrWfO8pw.

Curiosity-driven Exploration for Mapless Navigation with Deep Reinforcement Learning

Predictive Hierarchical Reinforcement Learning for Path-Efficient Mapless Navigation with Moving Target.

End-to-End Navigation Strategy with Deep Reinforcement Learning for Mobile Robots

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

On Reward Shaping for Mobile Robot Navigation: A Reinforcement Learning and SLAM Based Approach

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

A Curiosity-Based Autonomous Navigation Algorithm for Maze Robot

Learning Navigation Policies for Mobile Robots in Deep Reinforcement Learning with Random Network Distillation

Goal-Driven Autonomous Exploration Through Deep Reinforcement Learning

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer

A target-driven visual navigation method based on intrinsic motivation exploration and space topological cognition

Learning to Navigate in Indoor Environments: from Memorizing to Reasoning

An Efficient Deep Reinforcement Learning Algorithm for Mapless Navigation with Gap-Guided Switching Strategy

End-to-end Visual Navigation with Intrinsic Motivation in 3D Maze-like Environments

End-to-End Autonomous Exploration with Deep Reinforcement Learning and Intrinsic Motivation

Learning Exploration Policies for Navigation

Learning Reward Function with Matching Network for Mapless Navigation

Map-less End-to-end Navigation of Mobile Robots Via Deep Reinforcement Learning

Curiosity-driven Exploration by Self-supervised Prediction

A Deep Safe Reinforcement Learning Approach for Mapless Navigation.

Sim-to-Real: Mapless Navigation for USVs Using Deep Reinforcement Learning