Abstract:Human–robot interaction plays an important role in robots serving human production and life. Object handover between humans and robotics is one of the fundamental problems of human–robot interaction. The majority of current work uses parallel-jaw grippers as the end-effector device, which limits the ability of the robot to grab miscellaneous objects from human and manipulate them subsequently. In this article, we present a framework for human-to-robot dexterous handover using an anthropomorphic hand. The framework takes images captured by two cameras to complete handover scene understanding, grasp configurations prediction, and handover execution. To enable the robot to generalize to diverse delivered objects with miscellaneous shapes and sizes, we propose an anthropomorphic hand grasp network (AHG-Net), an end-to-end network that takes the single-view point clouds of the object as input and predicts the suitable anthropomorphic hand configurations with five different grasp taxonomies. To train our model, we build a large-scale data set with 1M hand grasp annotations from 5K single-view point clouds of 200 objects. We implement a handover system using a UR5 robot arm and HIT-DLR II anthropomorphic robot hand based on our presented framework, which can not only adapt to different human givers but generalize to diverse novel objects with various shapes and sizes. The generalizability, reliability, and robustness of our method are demonstrated on 15 different novel objects with arbitrary handover poses from frontal and lateral positions, a system ablation study, a grasp planner comparison, and a user study on 6 participants delivering 15 objects from two benchmark sets.

Skill Learning Framework for Human-Robot Interaction and Manipulation Tasks

Learning Robust Skills for Tightly Coordinated Arms in Contact-Rich Tasks

Robot Learning Method for Human-like Arm Skills Based on the Hybrid Primitive Framework

Human-Robot Variable Impedance Skills Transfer Learning Based on Dynamic Movement Primitives

A Combined Learning and Optimization Framework to Transfer Human Whole-body Loco-manipulation Skills to Mobile Manipulators

Multiform Adaptive Robot Skill Learning from Humans

Skill Learning for Human-Robot Interaction Using Wearable Device

Dynamic Movement Primitives Based Robot Skills Learning

Learning to Scaffold the Development of Robotic Manipulation Skills

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

An Adaptive Imitation Learning Framework for Robotic Complex Contact-Rich Insertion Tasks

An Adaptive Framework for Manipulator Skill Reproduction in Dynamic Environments

A neural network based framework for variable impedance skills learning from demonstrations

An Object Attribute Guided Framework for Robot Learning Manipulations from Human Demonstration Videos

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction

Learning Human-to-Robot Dexterous Handovers for Anthropomorphic Hand

Robot Variable Impedance Skill Transfer and Learning Framework Based on a Simplified Human Arm Impedance Model

Learning Physical Collaborative Robot Behaviors From Human Demonstrations

Human-Agent Joint Learning for Efficient Robot Manipulation Skill Acquisition

Robot Skill Learning in Human-Robot Collaboration with Dynamic Time Warping Iterative Learning Control

Learning Arm Movements Of Target Reaching For Humanoid Robot