Abstract:Industry 4.0 is taking human-robot collaboration at the center of the production environment. Collaborative robots enhance productivity and flexibility while reducing human's fatigue and the risk of injuries, exploiting advanced control methodologies. However, there is a lack of real-time model-based controllers accounting for the complex human-robot interaction dynamics. With this aim, this paper proposes a Model-Based Reinforcement Learning (MBRL) variable impedance controller to assist human operators in collaborative tasks. More in details, an ensemble of Artificial Neural Networks (ANNs) is used to learn a human-robot interaction dynamic model, capturing uncertainties. Such a learned model is kept updated during collaborative tasks execution. In addition, the learned model is used by a Model Predictive Controller (MPC) with Cross-Entropy Method (CEM). The aim of the MPC+CEM is to online optimize the stiffness and damping impedance control parameters minimizing the human effort (i.e, minimizing the human-robot interaction forces). The proposed approach has been validated through an experimental procedure. A lifting task has been considered as the reference validation application (weight of the manipulated part: 10 kg unknown to the robot controller). A KUKA LBR iiwa 14 R820 has been used as a test platform. Qualitative performance (i.e, questionnaire on perceived collaboration) have been evaluated. Achieved results have been compared with previous developed offline model-free optimized controllers and with the robot manual guidance controller. The proposed MBRL variable impedance controller shows improved human-robot collaboration. The proposed controller is capable to actively assist the human in the target task, compensating for the unknown part weight. The human-robot interaction dynamic model has been trained with a few initial experiments (30 initial experiments). In addition, the possibility to keep the learning of the human-robot interaction dynamics active allows accounting for the adaptation of human motor system.

Human-Robot Collaboration for Unknown Flexible Surface Exploration and Treatment Based on Mesh Iterative Learning Control.

Learning-Based Force Control of a Surgical Robot for Tool-Soft Tissue Interaction

Human-robot cooperation for robust surface treatment using non-conventional sliding mode control

Unified Contact Model and Hybrid Motion/force Control for Teleoperated Manipulation in Unknown Environments

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration

A Force Control Method Integrating Human Skills for Complex Surface Finishing

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Learning Force Control for Contact-Rich Manipulation Tasks With Rigid Position-Controlled Robots

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

Spatial Iterative Learning Control with Human Guidance and Visual Detection for Path Learning and Tracking

Adaptive human-inspired compliant contact primitives to perform surface–surface contact under uncertainty

Intelligent Interactive Control via Haptic E‐skin for Human–Robot Interaction and Collaboration

Human-Robot Collaboration With a Corrective Shared Controlled Robot in a Sanding Task

Interactive Force Control Based on Multimodal Robot Skin for Physical Human−Robot Collaboration

Unified Human-Robot-Environment Interaction Control in Contact-Rich Collaborative Manipulation Tasks Via Model-Based Reinforcement Learning

Automatic surface roughing with 3D machine vision and cooperative robot control

Efficient and Safe Contact-rich pHRI via Subtask Detection and Motion Estimation using Deep Learning

Real-Time Deformable-Contact-Aware Model Predictive Control for Force-Modulated Manipulation

An Electrical Impedance Tomography Based Interface for Human–Robot Collaboration