Abstract:Robotic learning for navigation in unfamiliar environments needs to provide policies for both task-oriented navigation (i.e., reaching a goal that the robot has located), and task-agnostic exploration (i.e., searching for a goal in a novel setting). Typically, these roles are handled by separate models, for example by using subgoal proposals, planning, or separate navigation strategies. In this paper, we describe how we can train a single unified diffusion policy to handle both goal-directed navigation and goal-agnostic exploration, with the latter providing the ability to search novel environments, and the former providing the ability to reach a user-specified goal once it has been located. We show that this unified policy results in better overall performance when navigating to visually indicated goals in novel environments, as compared to approaches that use subgoal proposals from generative models, or prior methods based on latent variable models. We instantiate our method by using a large-scale Transformer-based policy trained on data from multiple ground robots, with a diffusion model decoder to flexibly handle both goal-conditioned and goal-agnostic navigation. Our experiments, conducted on a real-world mobile robot platform, show effective navigation in unseen environments in comparison with five alternative methods, and demonstrate significant improvements in performance and lower collision rates, despite utilizing smaller models than state-of-the-art approaches. For more videos, code, and pre-trained model checkpoints, see <a class="link-external link-https" href="https://general-navigation-models.github.io/nomad/" rel="external noopener nofollow">this https URL</a>

Learning Exploration Policies for Navigation

A target-driven visual navigation method based on intrinsic motivation exploration and space topological cognition

3D-Aware Object Goal Navigation Via Simultaneous Exploration and Identification

Learning to explore by reinforcement over high-level options

A Hierarchical SLAM Framework Based on Deep Reinforcement Learning for Active Exploration

Learning to Explore using Active Neural SLAM

TopoNav: Topological Navigation for Efficient Exploration in Sparse Reward Environments

Autonomous Scene Exploration Using Experience Enhancement

Active Planning of Robot Navigation for 3D Scene Exploration

Curiosity-driven Exploration for Mapless Navigation with Deep Reinforcement Learning

NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration

Robotic Navigation using Entropy-Based Exploration

Interesting Object, Curious Agent: Learning Task-Agnostic Exploration

Think Holistically, Act Down-to-Earth: A Semantic Navigation Strategy with Continuous Environmental Representation and Multi-step Forward Planning

Learning Efficient Multi-Agent Cooperative Visual Exploration

Efficient Exploration in Constrained Environments with Goal-Oriented Reference Path

Exploitation-Guided Exploration for Semantic Embodied Navigation

Learning to Look Around: Intelligently Exploring Unseen Environments for Unknown Tasks

Learning Deployable Navigation Policies at Kilometer Scale from a Single Traversal

Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks

On the Complexity of Exploration in Goal-Driven Navigation