Abstract:To enable safe and efficient human-robot collaboration in shared workspaces it is important for the robot to predict how a human will move when performing a task. While predicting human motion for tasks not known a priori is very challenging, we argue that single-arm reaching motions for known tasks in collaborative settings (which are especially relevant for manufacturing) are indeed predictable. Two hypotheses underlie our approach for predicting such motions: First, that the trajectory the human performs is optimal with respect to an unknown cost function, and second, that human adaptation to their partner's motion can be captured well through iterative re-planning with the above cost function. The key to our approach is thus to learn a cost function which "explains" the motion of the human. To do this, we gather example trajectories from pairs of participants performing a collaborative assembly task using motion capture. We then use Inverse Optimal Control to learn a cost function from these trajectories. Finally, we predict reaching motions from the human's current configuration to a task-space goal region by iteratively re-planning a trajectory using the learned cost function. Our planning algorithm is based on the trajectory optimizer STOMP, it plans for a 23 DoF human kinematic model and accounts for the presence of a moving collaborator and obstacles in the environment. Our results suggest that in most cases, our method outperforms baseline methods when predicting motions. We also show that our method outperforms baselines for predicting human motion when a human and a robot share the workspace.

Role Dynamic Assignment of Human–Robot Collaboration Based on Target Prediction and Fuzzy Inference

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

Human Intention-Aware Motion Planning and Adaptive Fuzzy Control for a Collaborative Robot With Flexible Joints

Dynamic Human-Robot Role Allocation based on Human Ergonomics Risk Prediction and Robot Actions Adaptation

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

Role Dynamic Allocation of Human-Robot Cooperation Based on Reinforcement Learning in an Installation of Curtain Wall

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Human–Robot Shared Control Based on Locally Weighted Intent Prediction for a Teleoperated Hydraulic Manipulator System

Towards Efficient Human-Robot Collaboration With Robust Plan Recognition and Trajectory Prediction

Goal Set Inverse Optimal Control and Iterative Re-planning for Predicting Human Reaching Motions in Shared Workspaces

Role Adaptation of Human and Robot in Collaborative Tasks

Planning Coordinated Human-Robot Motions with Neural Network Full-Body Prediction Models

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Towards Better Human Robot Collaboration with Robust Plan Recognition and Trajectory Prediction

A Short-term Motion Prediction Approach for Guaranteed Collision-Free Planning.

Toward Proactive Human–Robot Collaborative Assembly: A Multimodal Transfer-Learning-Enabled Action Prediction Approach

Safe Human-Robot Collaborative Transportation via Trust-Driven Role Adaptation

A Dynamic Planner for Safe and Predictable Human-Robot Collaboration

Integrating Uncertainty-Aware Human Motion Prediction into Graph-Based Manipulator Motion Planning

A Hybrid Human Motion Prediction Approach For Human-Robot Collaboration

A Digital Twin-based environment-adaptive assignment method for human-robot collaboration