Abstract:Robots often face challenges in domestic environments where visual feedback is ineffective, such as retrieving objects obstructed by occlusions or finding a light switch in the dark. In these cases, utilizing contacts to localize the target object can be effective. We propose an online planning framework using binary contact signals for manipulation tasks with pose uncertainty, formulated as a Partially Observable Markov Decision Process (POMDP). Naively representing the belief as a particle set makes planning infeasible due to the large uncertainties in domestic settings, as identifying the best sequence of actions requires rolling out thousands of actions across millions of particles, taking significant compute time. To address this, we propose a hierarchical belief representation. Initially, we represent the uncertainty coarsely in a 3D volumetric space. Policies that refine uncertainty in this space are computed and executed, and once uncertainty is sufficiently reduced, the problem is translated back into the particle space for further refinement before task completion. We utilize a closed-loop planning and execution framework with a heuristic-search-based anytime solver that computes partial policies within a limited time budget. The performance of the framework is demonstrated both in real world and in simulation on the high-precision task of inserting a plug into a port using a UR10e manipulator, resolving positional uncertainties up to 50 centimeters and angular uncertainties close to $2\pi$. Experimental results highlight the framework's effectiveness, achieving a 93\% success rate in the real world and over 50\% improvement in solution quality compared to greedy baselines, significantly accelerating planning and enabling real-time solutions for complex problems.

Energy-based Contact Planning under Uncertainty for Robot Air Hockey

Efficient and Reactive Planning for High Speed Robot Air Hockey

AiRLIHockey: Highly Reactive Contact Control and Stochastic Optimal Shooting

A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics

A POMDP-based hierarchical planning framework for manipulation under pose uncertainty

Learning Control for Air Hockey Striking using Deep Reinforcement Learning

Learning to Play Air Hockey with Model-Based Deep Reinforcement Learning

Energy-Aware Planning-Scheduling for Autonomous Aerial Robots

A Game-Theoretic Framework for Joint Forecasting and Planning

Motion Planning of a Quadrotor Robot Game Using a Simulation-Based Projected Policy Iteration Method

Multi-agent Cooperative Manipulation with Uncertainty: a Neural Net-Based Game Theoretic Approach

Planning with a Receding Horizon for Manipulation in Clutter using a Learned Value Function

Uncertainty-Aware Planning for Heterogeneous Robot Teams using Dynamic Topological Graphs and Mixed-Integer Programming

Game-theoretic Objective Space Planning

Planning and Resilient Execution of Policies For Manipulation in Contact with Actuation Uncertainty

Robust Motion Planning in Dynamic Environments Based on Sampled-Data Hamilton–Jacobi Reachability

Bridging the gap between Learning-to-plan, Motion Primitives and Safe Reinforcement Learning

Role of Uncertainty in Anticipatory Trajectory Prediction for a Ping-Pong Playing Robot

Robot Air Hockey: A Manipulation Testbed for Robot Learning with Reinforcement Learning

LUCIDGames: Online Unscented Inverse Dynamic Games for Adaptive Trajectory Prediction and Planning