Abstract:This article investigates the challenge of achieving functional tool-use grasping with high-DoF anthropomorphic hands, with the aim of enabling anthropomorphic hands to perform tasks that require human-like manipulation and tool-use. However, accomplishing human-like grasping in real robots present many challenges, including obtaining diverse functional grasps for a wide variety of objects, handling generalization ability for kinematically diverse robot hands and precisely completing object shapes from a single-view perception. To tackle these challenges, we propose a six-step grasp synthesis algorithm based on fine-grained contact modeling that generates physically plausible and human-like functional grasps for category-level objects with minimal human demonstrations. With the contact-based optimization and learned dense shape correspondence, the proposed algorithm is adaptable to various objects in same category and a board range of robot hand models. To further demonstrate the robustness of the framework, over 10K functional grasps are synthesized to train our neural network, named DexFG-Net, which generates diverse sets of human-like functional grasps based on the reconstructed object model produced by a shape completion module. The proposed framework is extensively validated in simulation and on a real robot platform. Simulation experiments demonstrate that our method outperforms baseline methods by a large margin in terms of grasp functionality and success rate. Real robot experiments show that our method achieved an overall success rate of 79\% and 68\% for tool-use grasp on 3-D printed and real test objects, respectively, using a 5-Finger Schunk Hand. The experimental results indicate a step towards human-like grasping with anthropomorphic hands.

Grasp Planning Based on Strategy Extracted from Demonstration

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Robot Grasp Planning: A Learning from Demonstration-Based Approach

Work Day and Night: A Learning Based Illumination Irrelevant Grasp Planning Method

Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge

Unknown Objects Grasp Planning Using Force/Torque Measurements

DiPGrasp: Parallel Local Searching for Efficient Differentiable Grasp Planning

Learning to Grasp Familiar Objects Based on Experience

A Fast Grasp Planning Algorithm for Humanoid Robot Hands

Vision-Based Dexterous Motion Planning by Dynamic Movement Primitives with Human Hand Demonstration

Generalized Anthropomorphic Functional Grasping with Minimal Demonstrations

Design of Demonstration-Driven Assembling Manipulator

An Effective Method for Grasp Planning on Objects with Complex Geometry Combining Human Experience and Analytical Approach

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Planning Visual-Tactile Precision Grasps via Complementary Use of Vision and Touch

Screw Geometry Meets Bandits: Incremental Acquisition of Demonstrations to Generate Manipulation Plans

Inverse Kinematics of High Dimensional Robotic Arm-Hand Systems for Precision Grasping

Manipulation planning under changing external forces

Hybrid Learning- and Model-Based Planning and Control of In-Hand Manipulation

Modeling Grasp Type Improves Learning-Based Grasp Planning

Geometric In-Hand Regrasp Planning: Alternating Optimization of Finger Gaits and In-Grasp Manipulation