Abstract:The ability to accurately predict others' behavior is central to the safety and efficiency of interactive robotics. Unfortunately, robots often lack access to key information on which these predictions may hinge, such as other agents' goals, attention, and willingness to cooperate. Dual control theory addresses this challenge by treating unknown parameters of a predictive model as stochastic hidden states and inferring their values at runtime using information gathered during system operation. While able to optimally and automatically trade off exploration and exploitation, dual control is computationally intractable for general interactive motion planning. In this paper, we present a novel algorithmic approach to enable active uncertainty reduction for interactive motion planning based on the implicit dual control paradigm. Our approach relies on sampling-based approximation of stochastic dynamic programming, leading to a model predictive control problem that can be readily solved by real-time gradient-based optimization methods. The resulting policy is shown to preserve the dual control effect for a broad class of predictive models with both continuous and categorical uncertainty. To ensure the safe operation of the interacting agents, we use a runtime safety filter (also referred to as a "shielding" scheme), which overrides the robot's dual control policy with a safety fallback strategy when a safety-critical event is imminent. We then augment the dual control framework with an improved variant of the recently proposed shielding-aware robust planning scheme, which proactively balances the nominal planning performance with the risk of high-cost emergency maneuvers triggered by low-probability agent behaviors. We demonstrate the efficacy of our approach with both simulated driving studies and hardware experiments using 1/10 scale autonomous vehicles.

Uncertainty-Aware Reactive Control for Signal Temporal Logic with Unknown Obstacles

Efficient STL Control Synthesis under Asynchronous Temporal Robustness Constraints

Synthesis of Temporally-Robust Policies for Signal Temporal Logic Tasks using Reinforcement Learning

Signal Temporal Logic Control Synthesis among Uncontrollable Dynamic Agents with Conformal Prediction

Tunable Reactive Synthesis for Lipschitz-Bounded Systems with Temporal Logic Specifications

Temporal Logic Control for Nonlinear Stochastic Systems Under Unknown Disturbances

Probabilistic Tube-based Control Synthesis of Stochastic Multi-Agent Systems under Signal Temporal Logic

Distributed Receding Horizon Control for Multi-agent Systems with Conflicting Siganl Temporal Logic Tasks

On synthesizing robust discrete controllers under modeling uncertainty

Combined Left and Right Temporal Robustness for Control under STL Specifications

Event-Triggered Control for Safety-Critical Systems With Unknown Dynamics

Abstraction-Free Control Synthesis to Satisfy Temporal Logic Constraints under Sensor Faults and Attacks

Reactive and Risk-Aware Control for Signal Temporal Logic

Adaptive Safety-critical Control with Uncertainty Estimation for Human-robot Collaboration

Safe Non-Stochastic Control of Control-Affine Systems: An Online Convex Optimization Approach

Robust Dynamic Programming for Temporal Logic Control of Stochastic Systems

Safe Reinforcement Learning for Signal Temporal Logic Tasks Using Robust Control Barrier Functions

A Formal Control Framework of Autonomous Vehicle for Signal Temporal Logic Tasks and Obstacle Avoidance

Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approach

Secure-by-Construction Controller Synthesis for Stochastic Systems under Linear Temporal Logic Specifications

Safety-Critical Control with Uncertainty Quantification using Adaptive Conformal Prediction