Abstract:This article investigates the challenge of achieving functional tool-use grasping with high-DoF anthropomorphic hands, with the aim of enabling anthropomorphic hands to perform tasks that require human-like manipulation and tool-use. However, accomplishing human-like grasping in real robots present many challenges, including obtaining diverse functional grasps for a wide variety of objects, handling generalization ability for kinematically diverse robot hands and precisely completing object shapes from a single-view perception. To tackle these challenges, we propose a six-step grasp synthesis algorithm based on fine-grained contact modeling that generates physically plausible and human-like functional grasps for category-level objects with minimal human demonstrations. With the contact-based optimization and learned dense shape correspondence, the proposed algorithm is adaptable to various objects in same category and a board range of robot hand models. To further demonstrate the robustness of the framework, over 10K functional grasps are synthesized to train our neural network, named DexFG-Net, which generates diverse sets of human-like functional grasps based on the reconstructed object model produced by a shape completion module. The proposed framework is extensively validated in simulation and on a real robot platform. Simulation experiments demonstrate that our method outperforms baseline methods by a large margin in terms of grasp functionality and success rate. Real robot experiments show that our method achieved an overall success rate of 79\% and 68\% for tool-use grasp on 3-D printed and real test objects, respectively, using a 5-Finger Schunk Hand. The experimental results indicate a step towards human-like grasping with anthropomorphic hands.

Plausible and Diverse Human Hand Grasping Motion Generation

Learning Object Affordance with Contact and Grasp Generation

Realistic Virtual Hand Modeling with Applications for Virtual Grasping

Learning Realistic and Reasonable Grasps for Anthropomorphic Hand in Cluttered Scenes

D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions

DVGG: Deep Variational Grasp Generation for Dextrous Manipulation

DexHand: Dexterous Hand Manipulation Motion Synthesis for Virtual Reality

Towards Creating a Deployable Grasp Type Probability Estimator for a Prosthetic Hand

RegionGrasp: A Novel Task for Contact Region Controllable Hand Grasp Generation

Design And Use Of An Apparatus For Presenting Graspable Objects In 3d Workspace

Learning Diverse and Physically Feasible Dexterous Grasps with Generative Model and Bilevel Optimization

Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model

GraspXL: Generating Grasping Motions for Diverse Objects at Scale

Target Pose Guided Whole-body Grasping Motion Generation for Digital Humans

Multi-fingered Dynamic Grasping for Unknown Objects

GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistency

Learning Human-Like Functional Grasping for Multifinger Hands From Few Demonstrations

Video Driven Adaptive Grasp Planning of Virtual Hand Using Deep Reinforcement Learning

Generalized Anthropomorphic Functional Grasping with Minimal Demonstrations

FunGrasp: Functional Grasping for Diverse Dexterous Hands

ManiVideo: Generating Hand-Object Manipulation Video with Dexterous and Generalizable Grasping