Abstract:This article investigates the challenge of achieving functional tool-use grasping with high-DoF anthropomorphic hands, with the aim of enabling anthropomorphic hands to perform tasks that require human-like manipulation and tool-use. However, accomplishing human-like grasping in real robots present many challenges, including obtaining diverse functional grasps for a wide variety of objects, handling generalization ability for kinematically diverse robot hands and precisely completing object shapes from a single-view perception. To tackle these challenges, we propose a six-step grasp synthesis algorithm based on fine-grained contact modeling that generates physically plausible and human-like functional grasps for category-level objects with minimal human demonstrations. With the contact-based optimization and learned dense shape correspondence, the proposed algorithm is adaptable to various objects in same category and a board range of robot hand models. To further demonstrate the robustness of the framework, over 10K functional grasps are synthesized to train our neural network, named DexFG-Net, which generates diverse sets of human-like functional grasps based on the reconstructed object model produced by a shape completion module. The proposed framework is extensively validated in simulation and on a real robot platform. Simulation experiments demonstrate that our method outperforms baseline methods by a large margin in terms of grasp functionality and success rate. Real robot experiments show that our method achieved an overall success rate of 79\% and 68\% for tool-use grasp on 3-D printed and real test objects, respectively, using a 5-Finger Schunk Hand. The experimental results indicate a step towards human-like grasping with anthropomorphic hands.

Toward Human-Like Grasp: Dexterous Grasping via Semantic Representation of Object-Hand

DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Generalized Anthropomorphic Functional Grasping with Minimal Demonstrations

Learning Human-Like Functional Grasping for Multifinger Hands From Few Demonstrations

D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions

D(R, O) Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Grasping

RealDex: Towards Human-like Grasping for Robotic Dexterous Hand

Bimanual Grasp Synthesis for Dexterous Robot Hands

DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulation

Learning Task-Oriented Dexterous Grasping from Human Knowledge

Cross-Category Functional Grasp Tansfer

Grasp as You Say: Language-guided Dexterous Grasp Generation

Learning Robust Real-World Dexterous Grasping Policies via Implicit Shape Augmentation

DexTransfer: Real World Multi-fingered Dexterous Grasping with Minimal Human Demonstrations

Anthropomorphic Grasping with Neural Object Shape Completion

Data-driven grasp synthesis using shape matching and task-based pruning

Learning Generalizable Dexterous Manipulation from Human Grasp Affordance

GenDexGrasp: Generalizable Dexterous Grasping

Learning Human-to-Robot Dexterous Handovers for Anthropomorphic Hand

Cross-Category Functional Grasp Transfer