Abstract:The ability to accurately predict others' behavior is central to the safety and efficiency of interactive robotics. Unfortunately, robots often lack access to key information on which these predictions may hinge, such as other agents' goals, attention, and willingness to cooperate. Dual control theory addresses this challenge by treating unknown parameters of a predictive model as stochastic hidden states and inferring their values at runtime using information gathered during system operation. While able to optimally and automatically trade off exploration and exploitation, dual control is computationally intractable for general interactive motion planning. In this paper, we present a novel algorithmic approach to enable active uncertainty reduction for interactive motion planning based on the implicit dual control paradigm. Our approach relies on sampling-based approximation of stochastic dynamic programming, leading to a model predictive control problem that can be readily solved by real-time gradient-based optimization methods. The resulting policy is shown to preserve the dual control effect for a broad class of predictive models with both continuous and categorical uncertainty. To ensure the safe operation of the interacting agents, we use a runtime safety filter (also referred to as a "shielding" scheme), which overrides the robot's dual control policy with a safety fallback strategy when a safety-critical event is imminent. We then augment the dual control framework with an improved variant of the recently proposed shielding-aware robust planning scheme, which proactively balances the nominal planning performance with the risk of high-cost emergency maneuvers triggered by low-probability agent behaviors. We demonstrate the efficacy of our approach with both simulated driving studies and hardware experiments using 1/10 scale autonomous vehicles.

What problem does this paper attempt to address?

The paper attempts to address the problem of how to effectively reduce uncertainty in interactive motion planning while ensuring the safety and efficiency of the system. Specifically, when robots interact with other humans or multiple agents, they need to predict the behavior of these other agents. However, these predictions are often affected by incomplete information, such as a lack of understanding of the other agents' goals, attention, and willingness to cooperate. To tackle this challenge, the paper proposes a novel algorithmic approach based on an implicit dual control paradigm to achieve active uncertainty reduction. The main contributions of the paper include: 1. **Active Uncertainty Reduction**: Through an implicit dual control Stochastic Model Predictive Control (SMPC) method, the cost of exploration and exploitation is automatically balanced, enabling the robot to actively reduce uncertainty about the hidden states of other agents without sacrificing expected planning performance. 2. **Safety Assurance**: By incorporating shielding techniques, i.e., runtime safety filter schemes, a safe fallback policy overrides the dual control policy when a safety-critical event is imminent, ensuring the safe operation of the system and other agents. 3. **Balancing Efficiency and Safety**: The recently proposed Shielding-Aware Robust Planning (SHARP) framework is improved by explicitly considering the responses of other agents to the self-agent's probing actions, balancing nominal planning performance and the risk of high-cost emergency evasive maneuvers. The paper demonstrates the effectiveness of the proposed method through simulated driving studies and hardware experiments with 1/10 scale autonomous vehicles.

Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approach

Active Uncertainty Reduction for Human-Robot Interaction: An Implicit Dual Control Approach

Model-Based Robot Learning Control with Uncertainty Directed Exploration

SHARP: Shielding-Aware Robust Planning for Safe and Efficient Human-Robot Interaction

On Infusing Reachability-Based Safety Assurance within Probabilistic Planning Frameworks for Human-Robot Vehicle Interactions

On Infusing Reachability-Based Safety Assurance within Planning Frameworks for Human-Robot Vehicle Interactions

Adaptive Safety-critical Control with Uncertainty Estimation for Human-robot Collaboration

Safe Human-Interactive Control via Shielding.

Safe planning and control under uncertainty for self-driving

Probabilistically Safe Robot Planning with Confidence-Based Human Predictions

Learning-Based Shielding for Safe Autonomy under Unknown Dynamics

Risk-aware Safe Control for Decentralized Multi-agent Systems via Dynamic Responsibility Allocation

Safe Decentralized Multi-Agent Control using Black-Box Predictors, Conformal Decision Policies, and Control Barrier Functions

Safe Motion Planning and Control Framework for Automated Vehicles with Zonotopic TRMPC

Safe POMDP Online Planning via Shielding

Scenario-Based Motion Planning with Bounded Probability of Collision

Safety-Critical Control with Uncertainty Quantification using Adaptive Conformal Prediction

Interaction-Aware Motion Planning for Autonomous Vehicles with Multi-Modal Obstacle Uncertainty Predictions

Risk Bounded Nonlinear Robot Motion Planning With Integrated Perception & Control

Uncertainty-Aware Planning for Heterogeneous Robot Teams using Dynamic Topological Graphs and Mixed-Integer Programming

ISAACS: Iterative Soft Adversarial Actor-Critic for Safety