Abstract:Robots performing navigation tasks in complex environments face significant challenges due to uncertainty in state estimation. Effectively managing this uncertainty is crucial, but the optimal approach varies depending on the specific details of the task: different tasks require varying levels of precision in different regions of the environment. For instance, a robot navigating a crowded space might need precise localization near obstacles but can operate effectively with less precise state estimates in open areas. This varying need for certainty in different parts of the environment, depending on the task, calls for policies that can adapt their uncertainty management strategies based on task-specific requirements. In this paper, we present a framework for integrating task-specific uncertainty requirements directly into navigation policies. We introduce Task-Specific Uncertainty Map (TSUM), which represents acceptable levels of state estimation uncertainty across different regions of the operating environment for a given task. Using TSUM, we propose Generalized Uncertainty Integration for Decision-Making and Execution (GUIDE), a policy conditioning framework that incorporates these uncertainty requirements into the robot's decision-making process. We find that conditioning policies on TSUMs provides an effective way to express task-specific uncertainty requirements and enables the robot to reason about the context-dependent value of certainty. We show how integrating GUIDE into reinforcement learning frameworks allows the agent to learn navigation policies without the need for explicit reward engineering to balance task completion and uncertainty management. We evaluate GUIDE on a variety of real-world navigation tasks and find that it demonstrates significant improvements in task completion rates compared to baselines. Evaluation videos can be found at <a class="link-external link-https" href="https://guided-agents.github.io" rel="external noopener nofollow">this https URL</a>.

Learning Resilient Behaviors for Navigation Under Uncertainty

Uncertainty-Aware Reinforcement Learning for Collision Avoidance

Disentangling Uncertainty for Safe Social Navigation using Deep Reinforcement Learning

A Recurrent Reinforcement Learning Approach Applicable To Highly Uncertain Environments

A Behavior-Based Mobile Robot Navigation Method with Deep Reinforcement Learning

Navigation for Mobile Robots Using Reinforcement Learning and Fuzzy Logic

Learning Autonomous Navigation in Unmapped and Unknown Environments

Improving Reliable Navigation under Uncertainty via Predictions Informed by Non-Local Information

Evaluation of Safety Constraints in Autonomous Navigation with Deep Reinforcement Learning

Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perception

Author Correction: Stable Training Via Elastic Adaptive Deep Reinforcement Learning for Autonomous Navigation of Intelligent Vehicles

Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving

Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach

NavRL: Learning Safe Flight in Dynamic Environments

Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation

Learning With Stochastic Guidance for Robot Navigation

A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments

UNRealNet: Learning Uncertainty-Aware Navigation Features from High-Fidelity Scans of Real Environments

Robust Optimal Navigation Using Nonlinear Model Predictive Control Method Combined with Recurrent Fuzzy Neural Network

Robot Navigation with Entity-Based Collision Avoidance using Deep Reinforcement Learning

Enhancing Robot Navigation Policies with Task-Specific Uncertainty Management