Abstract:In this paper, we aim at improving human motion prediction during human-robot collaboration in industrial facilities by exploiting contributions from both physical and physiological signals. Improved human-machine collaboration could prove useful in several areas, while it is crucial for interacting robots to understand human movement as soon as possible to avoid accidents and injuries. In this perspective, we propose a novel human-robot interface capable to anticipate the user intention while performing reaching movements on a working bench in order to plan the action of a collaborative robot. The proposed interface can find many applications in the Industry 4.0 framework, where autonomous and collaborative robots will be an essential part of innovative facilities. A motion intention prediction and a motion direction prediction levels have been developed to improve detection speed and accuracy. A Gaussian Mixture Model (GMM) has been trained with IMU and EMG data following an evidence accumulation approach to predict reaching direction. Novel dynamic stopping criteria have been proposed to flexibly adjust the trade-off between early anticipation and accuracy according to the application. The output of the two predictors has been used as external inputs to a Finite State Machine (FSM) to control the behaviour of a physical robot according to user's action or inaction. Results show that our system outperforms previous methods, achieving a real-time classification accuracy of $94.3\pm2.9\%$ after $160.0msec\pm80.0msec$ from movement onset.

Human Motion Trajectory Prediction in Human-Robot Collaborative Tasks

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

Enhanced Human-Robot Collaboration using Constrained Probabilistic Human-Motion Prediction

Object Handover Prediction using Gaussian Processes clustered with Trajectory Classification

A Hybrid Human Motion Prediction Approach For Human-Robot Collaboration

Model Predictive Trajectory Planning for Human-Robot Handovers

Motion Planning Combines Human Motion Prediction for Human-Robot Cooperation

Human Arm Motion Prediction in Human-Robot Interaction Based on a Modified Minimum Jerk Model

Motion Prediction with Gaussian Processes for Safe Human-Robot Interaction in Virtual Environments

Long Short-Term Human Motion Prediction in Human-Robot Co-Carrying

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Motion Prediction With Gaussian Processes for Safe Human–Robot Interaction in Virtual Environments

Prediction of Human Reaching Pose Sequences In Human-Robot Collaboration

Recurrent Neural Network for Motion Trajectory Prediction in Human-Robot Collaborative Assembly

Deep Learning-based Human Motion Prediction considering Context Awareness for Human-Robot Collaboration in Manufacturing

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Motion Prediction Using Trajectory Cues

Towards Efficient Human-Robot Collaboration With Robust Plan Recognition and Trajectory Prediction

Advancing human-robot collaboration: Predicting operator trajectories through AI and infrared imaging

Fast human motion prediction for human-robot collaboration with wearable interfaces

Hierarchical Kernelized Movement Primitives for Learning Human-Robot Collaborative Trajectories in Referred Object Handover