Abstract:To improve the safety and effectiveness of human-robot collaboration (HRC), the robot must plan a safe trajectory before the human movement is finished. Therefore, it is necessary to enable proactive robot behavior by making accurate intention prediction decisions early in a human motion. Furthermore, it is desirable to not only provide the long-term trajectory prediction of human motion but also characterize the uncertainty around it. In this paper, we present a human motion prediction framework to predict the motion trajectory of human arm in a reaching task. The proposed framework combines partial trajectory classification and human motion regression. By leveraging on the partial trajectory classification, our framework makes it possible to recognize the human action and to provide a trajectory prediction before the human movement is finished. The human motion regression can compensate the low accuracy of the representative trajectory through the fusion strategy. The proposed framework consists of two phases: online phase and offline phase. The offline phase aims to learn a regression model with optimized hyperparameters and a fusion strategy combining different prediction algorithms. In the online phase, based on the partial motion classification, the future reaching trajectory in a given time step is predicted by using a multi-step Gaussian process regression and representative trajectory. Experimental results show that our proposed framework achieved significant performance.

Recurrent Neural Network for Motion Trajectory Prediction in Human-Robot Collaborative Assembly

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Deep Learning-Based Human Motion Recognition for Predictive Context-Aware Human-Robot Collaboration

A Human–Robot Collaboration Method Using a Pose Estimation Network for Robot Learning of Assembly Manipulation Trajectories From Demonstration Videos

Deep Learning-based Human Motion Prediction considering Context Awareness for Human-Robot Collaboration in Manufacturing

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Prediction of Human Trajectory Following a Haptic Robotic Guide Using Recurrent Neural Networks

An Accurate Prediction Method of Human Assembly Motion for Human–Robot Collaboration

Real-Time Human Fault Detection in Assembly Tasks, Based on Human Action Prediction Using a Spatio-Temporal Learning Model

Teaching Robots to Predict Human Motion

Prediction-Based Human-Robot Collaboration in Assembly Tasks Using a Learning from Demonstration Model

On human motion prediction using recurrent neural networks

Enhanced Human-Robot Collaboration using Constrained Probabilistic Human-Motion Prediction

Human motion prediction with gated recurrent unit model of multi-dimensional input

Multitask Non-Autoregressive Model For Human Motion Prediction

Prediction of Human Reaching Pose Sequences In Human-Robot Collaboration

Human Motion Trajectory Prediction in Human-Robot Collaborative Tasks

Hybrid machine learning for human action recognition and prediction in assembly