Abstract:Many tasks performed by two humans require mutual interaction between arms such as handing-over tools and objects. In order for a robotic arm to interact with a human in the same way, it must reason about the location of the human arm in real-time. Furthermore and to acquire interaction in a timely manner, the robot must be able predict the final target of the human in order to plan and initiate motion beforehand. In this paper, we explore the use of a low-cost wearable device equipped with two inertial measurement units (IMU) for learning reaching motion for real-time applications of Human-Robot Collaboration (HRC). A wearable device can replace or be complementary to visual perception in cases of bad lighting or occlusions in a cluttered environment. We first train a neural-network model to estimate the current location of the arm. Then, we propose a novel model based on a recurrent neural-network to predict the future target of the human arm during motion in real-time. Early prediction of the target grants the robot with sufficient time to plan and initiate motion during the motion of the human. The accuracies of the models are analyzed concerning the features included in the motion representation. Through experiments and real demonstrations with a robotic arm, we show that sufficient accuracy is achieved for feasible HRC without any visual perception. Once trained, the system can be deployed in various spaces with no additional effort. The models exhibit high accuracy for various initial poses of the human arm. Moreover, the trained models are shown to provide high success rates with additional human participants not included in the model training.

Human-robot cooperation using Kinect

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Design of Kinect-Based Human Robot Interaction Systems for A Robocup Middle Size League Soccer Robot

A Human-Robot Collaboration System for Object Handover

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgical operating room

On the Evaluation of Diverse Vision Systems towards Detecting Human Pose in Collaborative Robot Applications

A Haptic Shared Control Architecture for Tracking of a Moving Object.

Towards safe robot-human collaboration systems using human pose detection

A Multi-sensor Gesture Interaction System for Human-robot Cooperation

Towards Better Human Robot Collaboration with Robust Plan Recognition and Trajectory Prediction

Towards a Safe Human-Robot Collaboration Using Information on Human Worker Activity

Kinect-based dobby coordinate operating system

Advancing human-robot collaboration: Predicting operator trajectories through AI and infrared imaging

Human-Machine Cooperative Trajectory Planning and Tracking for Safe Automated Driving

Human Intention-Aware Motion Planning and Adaptive Fuzzy Control for a Collaborative Robot With Flexible Joints

Kinect-based Object Grasping by Manipulator

Learning Human-arm Reaching Motion Using IMU in Human-Robot Collaboration

Motion Planning for Human-Robot Interaction Based on Stereo Vision and Sift

Toward Safe Human-Robot Interaction: More Efficient Safety Monitoring Technology For Robotic Arms