Abstract:Human–robot interaction plays an important role in robots serving human production and life. Object handover between humans and robotics is one of the fundamental problems of human–robot interaction. The majority of current work uses parallel-jaw grippers as the end-effector device, which limits the ability of the robot to grab miscellaneous objects from human and manipulate them subsequently. In this article, we present a framework for human-to-robot dexterous handover using an anthropomorphic hand. The framework takes images captured by two cameras to complete handover scene understanding, grasp configurations prediction, and handover execution. To enable the robot to generalize to diverse delivered objects with miscellaneous shapes and sizes, we propose an anthropomorphic hand grasp network (AHG-Net), an end-to-end network that takes the single-view point clouds of the object as input and predicts the suitable anthropomorphic hand configurations with five different grasp taxonomies. To train our model, we build a large-scale data set with 1M hand grasp annotations from 5K single-view point clouds of 200 objects. We implement a handover system using a UR5 robot arm and HIT-DLR II anthropomorphic robot hand based on our presented framework, which can not only adapt to different human givers but generalize to diverse novel objects with various shapes and sizes. The generalizability, reliability, and robustness of our method are demonstrated on 15 different novel objects with arbitrary handover poses from frontal and lateral positions, a system ablation study, a grasp planner comparison, and a user study on 6 participants delivering 15 objects from two benchmark sets.

An Anthropomorphic Exploration Strategy of Unknown Object Based on Haptic Information of Dexterous Robot Hand

Haptic Perception Of Unknown Object By Robot Hand: Exploration Strategy And Recognition Approach

A Novel Star-Nose-Inspired Biomimetic Soft Robot for Non-Visual Spatial Exploration

Unknown Objects Grasp Planning Using Force/Torque Measurements

Dexterous Manoeuvre Through Touch in a Cluttered Scene

Adaptive Grasping of the Soft Prosthetic Hand Via Tactile Feedback

Grasp Configurations Optimization Of Dexterous Robotic Hand Based On Haptic Exploration Information

DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity

Design And Use Of An Apparatus For Presenting Graspable Objects In 3d Workspace

Sliding Touch-based Exploration for Modeling Unknown Object Shape with Multi-fingered Hands

DexH2R: Task-oriented Dexterous Manipulation from Human to Robots

Development of Robotic Hand Tactile Sensing System for Distributed Contact Force Sensing in Robotic Dexterous Multimodal Grasping

AcTExplore: Active Tactile Exploration of Unknown Objects

In-Hand Following of Deformable Linear Objects Using Dexterous Fingers with Tactile Sensing

Learning Human-to-Robot Dexterous Handovers for Anthropomorphic Hand

Object-Centric Dexterous Manipulation from Human Motion Data

Multi-fingered Dynamic Grasping for Unknown Objects

Design and Analysis of Intelligent Data Acquisition System Based on Robotic Arms

Surface material recognition through haptic exploration using an intelligent contact sensing finger

Enhancing Dexterity in Robotic Manipulation via Hierarchical Contact Exploration