Abstract:Building hand-object models for dexterous in-hand manipulation remains a crucial and open problem. Major challenges include the difficulty of obtaining the geometric and dynamical models of the hand, object, and time-varying contacts, as well as the inevitable physical and perception uncertainties. Instead of building accurate models to map between the actuation inputs and the object motions, this work proposes to enable the hand-object systems to continuously approximate their local models via a self-identification process where an underlying manipulation model is estimated through a small number of exploratory actions and non-parametric learning. With a very small number of data points, as opposed to most data-driven methods, our system self-identifies the underlying manipulation models online through exploratory actions and non-parametric learning. By integrating the self-identified hand-object model into a model predictive control framework, the proposed system closes the control loop to provide high accuracy in-hand manipulation. Furthermore, the proposed self-identification is able to adaptively trigger online updates through additional exploratory actions, as soon as the self-identified local models render large discrepancies against the observed manipulation outcomes. We implemented the proposed approach on a sensorless underactuated Yale Model O hand with a single external camera to observe the object's motion. With extensive experiments, we show that the proposed self-identification approach can enable accurate and robust dexterous manipulation without requiring an accurate system model nor a large amount of data for offline training.

Robust In-Hand Manipulation with Extrinsic Contacts

Robust Dexterous Manipulation Under Object Dynamics Uncertainties

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Tactile-Driven Non-Prehensile Object Manipulation via Extrinsic Contact Mode Control

Robust Anthropomorphic Robotic Manipulation through Biomimetic Distributed Compliance

Complex In-Hand Manipulation via Compliance-Enabled Finger Gaiting and Multi-Modal Planning

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Hybrid Learning- and Model-Based Planning and Control of In-Hand Manipulation

Robust Visual Feedback Control for Precise In-Hand Manipulation Using Parallel Soft Actuators

TEXterity -- Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity

In-Hand Manipulation with Soft Fingertips

Adaptive Fingers Coordination for Robust Grasp and In-Hand Manipulation Under Disturbances and Unknown Dynamics

Simultaneous Tactile Estimation and Control of Extrinsic Contact

Inverse Kinematics of High Dimensional Robotic Arm-Hand Systems for Precision Grasping

One-Shot Transfer of Long-Horizon Extrinsic Manipulation Through Contact Retargeting

Robotic in-hand manipulation with relaxed optimization

Enhancing Dexterity in Robotic Manipulation via Hierarchical Contact Exploration

Complementarity-Free Multi-Contact Modeling and Optimization for Dexterous Manipulation

Non-Parametric Self-Identification and Model Predictive Control of Dexterous In-Hand Manipulation

Learning Haptic-Based Object Pose Estimation for In-Hand Manipulation Control With Underactuated Robotic Hands