Abstract:This paper presents a hierarchical framework for planning and control of in-hand manipulation of a rigid object involving grasp changes using fully-actuated multifingered robotic hands. While the framework can be applied to the general dexterous manipulation, we focus on a more complex definition of in-hand manipulation, where at the goal pose the hand has to reach a grasp suitable for using the object as a tool. The high level planner determines the object trajectory as well as the grasp changes, i.e. adding, removing, or sliding fingers, to be executed by the low-level controller. While the grasp sequence is planned online by a learning-based policy to adapt to variations, the trajectory planner and the low-level controller for object tracking and contact force control are exclusively model-based to robustly realize the plan. By infusing the knowledge about the physics of the problem and the low-level controller into the grasp planner, it learns to successfully generate grasps similar to those generated by model-based optimization approaches, obviating the high computation cost of online running of such methods to account for variations. By performing experiments in physics simulation for realistic tool use scenarios, we show the success of our method on different tool-use tasks and dexterous hand models. Additionally, we show that this hybrid method offers more robustness to trajectory and task variations compared to a model-based method.

A Hybrid System Approach to Kinematic Modelling of Mutlifingered Hand's Finger Gaits

Hybrid Automaton: A Better Model of Finger Gaits

Hybrid Mapping Method: from Human to Robotic Hands with Dissimilar Kinematics

Realistic Virtual Hand Modeling with Applications for Virtual Grasping

A Practical Model of Hybrid Robotic Hands for Grasping Applications Based on Bioinspired Form

Biodynamic modeling, system identification, and variability of multi-finger movements.

The Multi-fingered Kinematic Model for Dual-arm Manipulation

General Kinematic Solution and Mobility Analysis of Multi-fingered Hand Manipulation System

Multifingered Grasping Based on Multimodal Reinforcement Learning

Kinematic Algorithm of Multifingered Manipulation with Rolling Contact

Algorithm for the kinematics of dexterous manipulation

Datag love based grasp planning for multi-fingered robot hand

Hybrid Learning- and Model-Based Planning and Control of In-Hand Manipulation

Inverse Kinematics of High Dimensional Robotic Arm-Hand Systems for Precision Grasping

A Hybrid Interaction Method with Virtual Hand

Dynamic Modeling and Analysis for Robotic Arm-Hand Systems

Modelling And Analyzing Of Postural Synergy Based Underactuated Robotic Hand With Contact And Friction Constraints

Multi- fingered manipulation with HIT/DLR hand

Enhanced Kinematic Model for Dexterous Manipulation with an Underactuated Hand

Mapping Human Hand Motion to Dexterous Robotic Hand.

Underactuated Hand Dynamic Modeling, Its Real-Time Simulation, And Control