Abstract:Development of navigation algorithms is essential for the successful deployment of robots in rapidly changing hazardous environments for which prior knowledge of configuration is often limited or unavailable. Use of traditional path-planning algorithms, which are based on localization and require detailed obstacle maps with goal locations, is not possible. In this regard, vision-based algorithms hold great promise, as visual information can be readily acquired by a robot's onboard sensors and provides a much richer source of information from which deep neural networks can extract complex patterns. Deep reinforcement learning has been used to achieve vision-based robot navigation. However, the efficacy of these algorithms in environments with dynamic obstacles and high variation in the configuration space has not been thoroughly investigated. In this paper, we employ a deep Dyna-Q learning algorithm for room evacuation and obstacle avoidance in partially observable environments based on low-resolution raw image data from an onboard camera. We explore the performance of a robotic agent in environments containing no obstacles, convex obstacles, and concave obstacles, both static and dynamic. Obstacles and the exit are initialized in random positions at the start of each episode of reinforcement learning. Overall, we show that our algorithm and training approach can generalize learning for collision-free evacuation of environments with complex obstacle configurations. It is evident that the agent can navigate to a goal location while avoiding multiple static and dynamic obstacles, and can escape from a concave obstacle while searching for and navigating to the exit.

Emergent Braitenberg-style Behaviours for Navigating the ViZDoom `My Way Home' Labyrinth

A computational model of learning flexible navigation in a maze by layout-conforming replay of place cells

Learning to Navigate in Complex Environments

Coordinated exploration for labyrinthine environments with application to the Pursuit-Evasion problem

A transformer-based deep reinforcement learning approach to spatial navigation in a partially observable Morris Water Maze

Home Run: Finding Your Way Home by Imagining Trajectories

Moving Architecture, Animated Maze: The Intertextuality Between Player and Environment Agents

On the Complexity of Exploration in Goal-Driven Navigation

Exploring and Learning Structure: Active Inference Approach in Navigational Agents

Tutor-Guided Interior Navigation With Deep Reinforcement Learning

Learning Dynamic Cognitive Map with Autonomous Navigation

Visuospatial navigation without distance, prediction, or maps

A target-driven visual navigation method based on intrinsic motivation exploration and space topological cognition

Combining Vision, Machine Learning and Automatic Control to Play the Labyrinth Game

Emergence of Locomotion Behaviours in Rich Environments

Learning with a Mole: Transferable latent spatial representations for navigation without reconstruction

Continual Reinforcement Learning in 3D Non-stationary Environments

Sample-Efficient Learning to Solve a Real-World Labyrinth Game Using Data-Augmented Model-Based Reinforcement Learning

Vision-based navigation and obstacle avoidance via deep reinforcement learning

Investigating Navigation Strategies in the Morris Water Maze through Deep Reinforcement Learning

Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks