Abstract:Exploration in an unknown environment is the core functionality for mobile robots. Learning-based exploration methods, including convolutional neural networks, provide excellent strategies without human-designed logic for the feature extraction. But the conventional supervised learning algorithms cost lots of efforts on the labeling work of datasets inevitably. Scenes not included in the training set are mostly unrecognized either. We propose a deep reinforcement learning method for the exploration of mobile robots in an indoor environment with the depth information from an RGB-D sensor only. Based on the Deep Q-Network framework, the raw depth image is taken as the only input to estimate the Q values corresponding to all moving commands. The training of the network weights is end-to-end. In arbitrarily constructed simulation environments, we show that the robot can be quickly adapted to unfamiliar scenes without any man-made labeling. Besides, through analysis of receptive fields of feature representations, deep reinforcement learning motivates the convolutional networks to estimate the traversability of the scenes. The test results are compared with the exploration strategies separately based on deep learning or reinforcement learning. Even trained only in the simulated environment, experimental results in real-world environment demonstrate that the cognitive ability of robot controller is dramatically improved compared with the supervised method. We believe it is the first time that raw sensor information is used to build cognitive exploration strategy for mobile robots through end-to-end deep reinforcement learning.

Autonomous Exploration for Mobile Robot using Q-learning

Reinforcement Extreme Learning Machine For Mobile Robot Navigation

An Efficient Learning Based Autonomous Exploration Algorithm for Mobile Robots.

An optimized Q-Learning algorithm for mobile robot local path planning

Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning

Robot path planning using deep reinforcement learning

Biologically Inspired Complete Coverage Path Planning Algorithm Based on Q-Learning

A Mapless Local Path Planning Approach Using Deep Reinforcement Learning Framework

Towards Cognitive Exploration through Deep Reinforcement Learning for Mobile Robots

Automatic Object Searching and Behavior Learning for Mobile Robots in Unstructured Environment by Deep Belief Networks.

Reinforcement Learning-Based Path Planning Algorithm for Mobile Robots

A path planning approach for mobile robots using short and safe Q-learning.

An event-based probabilistic Q-learning method for navigation control of mobile robots

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

A Distributed Path Planning Algorithm via Reinforcement Learning

Research on path planning algorithm of mobile robot based on reinforcement learning

Robot Crowd Navigation in Dynamic Environment with Offline Reinforcement Learning

Path Planning Method of Mobile Robot Using Improved Deep Reinforcement Learning

Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Reinforcement Learning for Navigation of Mobile Robot with LiDAR