Abstract:Robots often face challenges in domestic environments where visual feedback is ineffective, such as retrieving objects obstructed by occlusions or finding a light switch in the dark. In these cases, utilizing contacts to localize the target object can be effective. We propose an online planning framework using binary contact signals for manipulation tasks with pose uncertainty, formulated as a Partially Observable Markov Decision Process (POMDP). Naively representing the belief as a particle set makes planning infeasible due to the large uncertainties in domestic settings, as identifying the best sequence of actions requires rolling out thousands of actions across millions of particles, taking significant compute time. To address this, we propose a hierarchical belief representation. Initially, we represent the uncertainty coarsely in a 3D volumetric space. Policies that refine uncertainty in this space are computed and executed, and once uncertainty is sufficiently reduced, the problem is translated back into the particle space for further refinement before task completion. We utilize a closed-loop planning and execution framework with a heuristic-search-based anytime solver that computes partial policies within a limited time budget. The performance of the framework is demonstrated both in real world and in simulation on the high-precision task of inserting a plug into a port using a UR10e manipulator, resolving positional uncertainties up to 50 centimeters and angular uncertainties close to $2\pi$. Experimental results highlight the framework's effectiveness, achieving a 93\% success rate in the real world and over 50\% improvement in solution quality compared to greedy baselines, significantly accelerating planning and enabling real-time solutions for complex problems.

Planning and Resilient Execution of Policies For Manipulation in Contact with Actuation Uncertainty

An adaptive compliance position control based on EKF for series elastic actuation

A POMDP-based hierarchical planning framework for manipulation under pose uncertainty

Meta-Policy Learning over Plan Ensembles for Robust Articulated Object Manipulation

Pushing Fast and Slow: Task-Adaptive Planning for Non-prehensile Manipulation Under Uncertainty

Robust Physics-Based Manipulation by Interleaving Open and Closed-Loop Execution

Robust Motion Planning in Dynamic Environments Based on Sampled-Data Hamilton–Jacobi Reachability

Can't Touch This: Real-Time, Safe Motion Planning and Control for Manipulators Under Uncertainty

Serving Time: Real-Time, Safe Motion Planning and Control for Manipulation of Unsecured Objects

Collision-inclusive Manipulation Planning for Occluded Object Grasping via Compliant Robot Motions

Combining Planning and Diffusion for Mobility with Unknown Dynamics

Planning and Control of Meso-scale Manipulation Tasks with Uncertainties

Manipulation planning under changing external forces

Risk-Aware Motion Planning for a Limbed Robot with Stochastic Gripping Forces Using Nonlinear Programming

Accelerating Search-Based Planning for Multi-Robot Manipulation by Leveraging Online-Generated Experiences

Robust Motion Planning in the Presence of Estimation Uncertainty

Configuration Lattices for Planar Contact Manipulation Under Uncertainty

Planning for Complex Non-prehensile Manipulation Among Movable Objects by Interleaving Multi-Agent Pathfinding and Physics-Based Simulation

Implicit Contact-Rich Manipulation Planning for a Manipulator with Insufficient Payload

Robust Pushing: Exploiting Quasi-static Belief Dynamics and Contact-informed Optimization

Rearrangement-Based Manipulation via Kinodynamic Planning and Dynamic Planning Horizons