Abstract:Development of navigation algorithms is essential for the successful deployment of robots in rapidly changing hazardous environments for which prior knowledge of configuration is often limited or unavailable. Use of traditional path-planning algorithms, which are based on localization and require detailed obstacle maps with goal locations, is not possible. In this regard, vision-based algorithms hold great promise, as visual information can be readily acquired by a robot's onboard sensors and provides a much richer source of information from which deep neural networks can extract complex patterns. Deep reinforcement learning has been used to achieve vision-based robot navigation. However, the efficacy of these algorithms in environments with dynamic obstacles and high variation in the configuration space has not been thoroughly investigated. In this paper, we employ a deep Dyna-Q learning algorithm for room evacuation and obstacle avoidance in partially observable environments based on low-resolution raw image data from an onboard camera. We explore the performance of a robotic agent in environments containing no obstacles, convex obstacles, and concave obstacles, both static and dynamic. Obstacles and the exit are initialized in random positions at the start of each episode of reinforcement learning. Overall, we show that our algorithm and training approach can generalize learning for collision-free evacuation of environments with complex obstacle configurations. It is evident that the agent can navigate to a goal location while avoiding multiple static and dynamic obstacles, and can escape from a concave obstacle while searching for and navigating to the exit.

Deep Reinforcement Learning Boosted by External Knowledge

Playing FPS Games with Deep Reinforcement Learning

Emergent Solutions to High-Dimensional Multitask Reinforcement Learning

Learning a World Model With Multitimescale Memory Augmentation

Object-sensitive Deep Reinforcement Learning

Architecting and Visualizing Deep Reinforcement Learning Models

Developmental Reinforcement Learning Through Sensorimotor Space Enlargement

Visual Reinforcement Learning with Self-Supervised 3D Representations

Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control

Following Instructions by Imagining and Reaching Visual Goals

Learning Complicated Navigation Skills from Limited Experience Via Augmenting Offline Datasets

Image-Based Deep Reinforcement Learning with Intrinsically Motivated Stimuli: On the Execution of Complex Robotic Tasks

Vision-based navigation and obstacle avoidance via deep reinforcement learning

Pre-training with Non-expert Human Demonstration for Deep Reinforcement Learning

Deep Apprenticeship Learning for Playing Games

Playing Atari with Deep Reinforcement Learning

Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learning

Hierarchical Reinforcement Learning in Complex 3D Environments

Reinforcement Learning with Unsupervised Auxiliary Tasks

A Human Mixed Strategy Approach to Deep Reinforcement Learning