Abstract:Human–robot interaction plays an important role in robots serving human production and life. Object handover between humans and robotics is one of the fundamental problems of human–robot interaction. The majority of current work uses parallel-jaw grippers as the end-effector device, which limits the ability of the robot to grab miscellaneous objects from human and manipulate them subsequently. In this article, we present a framework for human-to-robot dexterous handover using an anthropomorphic hand. The framework takes images captured by two cameras to complete handover scene understanding, grasp configurations prediction, and handover execution. To enable the robot to generalize to diverse delivered objects with miscellaneous shapes and sizes, we propose an anthropomorphic hand grasp network (AHG-Net), an end-to-end network that takes the single-view point clouds of the object as input and predicts the suitable anthropomorphic hand configurations with five different grasp taxonomies. To train our model, we build a large-scale data set with 1M hand grasp annotations from 5K single-view point clouds of 200 objects. We implement a handover system using a UR5 robot arm and HIT-DLR II anthropomorphic robot hand based on our presented framework, which can not only adapt to different human givers but generalize to diverse novel objects with various shapes and sizes. The generalizability, reliability, and robustness of our method are demonstrated on 15 different novel objects with arbitrary handover poses from frontal and lateral positions, a system ablation study, a grasp planner comparison, and a user study on 6 participants delivering 15 objects from two benchmark sets.

Machine Learning Driven Human Skill Transferring for Control of Anthropomorphic Manipulators

Deep Neural Network Approach in Human-Like Redundancy Optimization for Anthropomorphic Manipulators.

Control of Antagonistic McKibben Muscles Via a Bio-inspired Approach

An Incremental Learning Framework for Human-Like Redundancy Optimization of Anthropomorphic Manipulators

Deep Learning Based Human-Robot Co-Manipulation for a Mobile Manipulator

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

A Combined Learning and Optimization Framework to Transfer Human Whole-body Loco-manipulation Skills to Mobile Manipulators

Human-Robot Variable Impedance Skills Transfer Learning Based on Dynamic Movement Primitives

Learning Responsive Humanoid Motion Skills from Graph-Powered Motion Matching

Learning Human-to-Robot Dexterous Handovers for Anthropomorphic Hand

Skill Learning Framework for Human-Robot Interaction and Manipulation Tasks

Behavior Imitation for Manipulator Control and Grasping with Deep Reinforcement Learning

Human-Robot Coordination Control of Robotic Exoskeletons by Skill Transfers.

The Role of Learning and Kinematic Features in Dexterous Manipulation: A Comparative Study with Two Robotic Hands

Dynamic Skill Learning from Human Demonstration Based on the Human Arm Stiffness Estimation Model and Riemannian DMP

Reinforcement Learning Based Manipulation Skill Transferring for Robot-assisted Minimally Invasive Surgery.

Online Human-Like Redundancy Optimization for Tele-Operated Anthropomorphic Manipulators

Human-Agent Joint Learning for Efficient Robot Manipulation Skill Acquisition

Model Predictive Control for Fluid Human-to-Robot Handovers

Human-Manipulator Interface Using Hybrid Sensors Via CMAC for Dual Robots.

Human-robot co-manipulation of extended objects: Data-driven models and control from analysis of human-human dyads