Abstract:We present a control framework for achieving a robust object grasp and manipulation in hand. In-hand manipulation remains a demanding task as the object is never stable and task success relies on carefully synchronizing the fingers' dynamics. Indeed, fingers must simultaneously generate motion while maintaining contact with the object and, by staying within the hand's frame, ensuring that the object remains manipulable. These challenges are exacerbated once the hand gets disturbed or when the internal dynamics of the manipulated object are unknown, such as when it is filled with liquid moving during manipulation. We present a control strategy based on coupled dynamical systems (DSs), whereby the fingers move in synchronization using an intermediate dynamics responsible for coordinating fingers. To adapt to changes in forces due to model uncertainties and unexpected disturbances, we employ an adaptive torque-controller combined with a joint impedance regulator that guarantees high tracking accuracy while adapting to dynamic changes. We validate the approach in multiple experiments on 16-degrees-of-freedom robotic hand grasping and manipulating objects with different mass properties, e.g., uneven or varying mass distribution in a glass half-filled with water. We show that the robot can compensate for disturbances generated by internal dynamics and external perturbations. Additionally, we showcase how our controller, in conjunction with learning from human demonstration, provides a robust solution for more complicated manipulations such as finger gaiting.

In-Hand Object Stabilization by Independent Finger Control

Can Modular Finger Control for In-Hand Object Stabilization be accomplished by Independent Tactile Feedback Control Laws?

A Bioinspired Gripper with Sequential Motion and Mutable Posture Enabled by Antagonistic Mechanism

Grasping Force Control of Multi-Fingered Robotic Hands Through Tactile Sensing for Object Stabilization.

Adaptive Fingers Coordination for Robust Grasp and In-Hand Manipulation Under Disturbances and Unknown Dynamics

Tactile-Driven Non-Prehensile Object Manipulation via Extrinsic Contact Mode Control

Hierarchical Tactile-Based Control Decomposition of Dexterous In-Hand Manipulation Tasks

TEXterity -- Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity

Tactile sensor-less fingertip contact detection and force estimation for stable grasping with an under-actuated hand

In-Hand Manipulation with Soft Fingertips

Tactile-Driven Gentle Grasping for Human-Robot Collaborative Tasks

Optimal Control and Grasping for a Robotic Hand with a Non-linked Double Tendon Arrangement

Integrating vision, haptics and proprioception into a feedback controller for in-hand manipulation of unknown objects

TEXterity: Tactile Extrinsic deXterity

Dexterous object manipulation by a multi-fingered robotic hand with visual-tactile fingertip sensors

Tactile-sensing-based robotic grasping stability analysis

Grasping and Coordinated Manipulation by a Multifingered Robot Hand

Status Identification and Object In-Hand Reorientation Using Force/Torque Sensors

Precise In-Hand Manipulation of Soft Objects using Soft Fingertips with Tactile Sensing and Active Deformation

Learning Haptic-Based Object Pose Estimation for In-Hand Manipulation Control With Underactuated Robotic Hands

Robust In-Hand Manipulation with Extrinsic Contacts