Abstract:Many tasks performed by two humans require mutual interaction between arms such as handing-over tools and objects. In order for a robotic arm to interact with a human in the same way, it must reason about the location of the human arm in real-time. Furthermore and to acquire interaction in a timely manner, the robot must be able predict the final target of the human in order to plan and initiate motion beforehand. In this paper, we explore the use of a low-cost wearable device equipped with two inertial measurement units (IMU) for learning reaching motion for real-time applications of Human-Robot Collaboration (HRC). A wearable device can replace or be complementary to visual perception in cases of bad lighting or occlusions in a cluttered environment. We first train a neural-network model to estimate the current location of the arm. Then, we propose a novel model based on a recurrent neural-network to predict the future target of the human arm during motion in real-time. Early prediction of the target grants the robot with sufficient time to plan and initiate motion during the motion of the human. The accuracies of the models are analyzed concerning the features included in the motion representation. Through experiments and real demonstrations with a robotic arm, we show that sufficient accuracy is achieved for feasible HRC without any visual perception. Once trained, the system can be deployed in various spaces with no additional effort. The models exhibit high accuracy for various initial poses of the human arm. Moreover, the trained models are shown to provide high success rates with additional human participants not included in the model training.

Uncertainty-Assisted Image-Processing for Human-Robot Close Collaboration

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

An Uncertainty Estimation Framework for Probabilistic Object Detection

Uncertainty Estimation for Safe Human-Robot Collaboration using Conservation Measures

Quantifying Uncertainties of Contact Classifications in a Human-Robot Collaboration with Parallel Robots

A framework for robotic arm pose estimation and movement prediction based on deep and extreme learning models

Experimental Evaluation of Human Motion Prediction: Toward Safe and Efficient Human Robot Collaboration

Robotic Task Success Evaluation Under Multi-modal Non-Parametric Object Pose Uncertainty

Towards a Safe Human-Robot Collaboration Using Information on Human Worker Activity

Multimodal Uncertainty Reduction for Intention Recognition in Human-Robot Interaction

A collaborative intelligence-based approach for handling human-robot collaboration uncertainties

Single Image based 3D Human Pose Estimation via Uncertainty Learning

Adaptive Safety-critical Control with Uncertainty Estimation for Human-robot Collaboration

Uncertainty-Aware Shared Autonomy System with Hierarchical Conservative Skill Inference

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

Learning Human-arm Reaching Motion Using IMU in Human-Robot Collaboration

Fast Uncertainty Quantification for Deep Object Pose Estimation

Probabilistic Uncertainty Quantification of Prediction Models with Application to Visual Localization

Human-Aware Collaborative Robots in the Wild: Coping with Uncertainty in Activity Recognition

Enhanced Human-Robot Collaboration using Constrained Probabilistic Human-Motion Prediction

Advancing human-robot collaboration: Predicting operator trajectories through AI and infrared imaging