Abstract:Real-time path planning in outdoor environments still challenges modern robotic systems due to differences in terrain traversability, diverse obstacles, and the necessity for fast decision-making. Established approaches have primarily focused on geometric navigation solutions, which work well for structured geometric obstacles but have limitations regarding the semantic interpretation of different terrain types and their affordances. Moreover, these methods fail to identify traversable geometric occurrences, such as stairs. To overcome these issues, we introduce ViPlanner, a learned local path planning approach that generates local plans based on geometric and semantic information. The system is trained using the Imperative Learning paradigm, for which the network weights are optimized end-to-end based on the planning task objective. This optimization uses a differentiable formulation of a semantic costmap, which enables the planner to distinguish between the traversability of different terrains and accurately identify obstacles. The semantic information is represented in 30 classes using an RGB colorspace that can effectively encode the multiple levels of traversability. We show that the planner can adapt to diverse real-world environments without requiring any real-world training. In fact, the planner is trained purely in simulation, enabling a highly scalable training data generation. Experimental results demonstrate resistance to noise, zero-shot sim-to-real transfer, and a decrease of 38.02% in terms of traversability cost compared to purely geometric-based approaches. Code and models are made publicly available:

IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigation

Active Planning of Robot Navigation for 3D Scene Exploration

Informed sampling space driven robot informative path planning

Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill

3D-Aware Object Goal Navigation Via Simultaneous Exploration and Identification

Cognitive Planning for Object Goal Navigation using Generative AI Models

Online Informative Path Planning of Autonomous Vehicles Using Kernel-Based Bayesian Optimization

Efficient Exploration in Constrained Environments with Goal-Oriented Reference Path

PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learning

ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation

Object Goal Navigation using Goal-Oriented Semantic Exploration

ViPlanner: Visual Semantic Imperative Learning for Local Navigation

GAMap: Zero-Shot Object Goal Navigation with Multi-Scale Geometric-Affordance Guidance

Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation

A Contextual Bandit Approach for Learning to Plan in Environments with Probabilistic Goal Configurations

Traversing Mars: Cooperative Informative Path Planning to Efficiently Navigate Unknown Scenes

Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation

Semantic Path Planning for Indoor Navigation Tasks Using Multi-View Context and Prior Knowledge.

ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddings

IN-Sight: Interactive Navigation through Sight

SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Tasks