Abstract:Industry 4.0 is taking human-robot collaboration at the center of the production environment. Collaborative robots enhance productivity and flexibility while reducing human's fatigue and the risk of injuries, exploiting advanced control methodologies. However, there is a lack of real-time model-based controllers accounting for the complex human-robot interaction dynamics. With this aim, this paper proposes a Model-Based Reinforcement Learning (MBRL) variable impedance controller to assist human operators in collaborative tasks. More in details, an ensemble of Artificial Neural Networks (ANNs) is used to learn a human-robot interaction dynamic model, capturing uncertainties. Such a learned model is kept updated during collaborative tasks execution. In addition, the learned model is used by a Model Predictive Controller (MPC) with Cross-Entropy Method (CEM). The aim of the MPC+CEM is to online optimize the stiffness and damping impedance control parameters minimizing the human effort (i.e, minimizing the human-robot interaction forces). The proposed approach has been validated through an experimental procedure. A lifting task has been considered as the reference validation application (weight of the manipulated part: 10 kg unknown to the robot controller). A KUKA LBR iiwa 14 R820 has been used as a test platform. Qualitative performance (i.e, questionnaire on perceived collaboration) have been evaluated. Achieved results have been compared with previous developed offline model-free optimized controllers and with the robot manual guidance controller. The proposed MBRL variable impedance controller shows improved human-robot collaboration. The proposed controller is capable to actively assist the human in the target task, compensating for the unknown part weight. The human-robot interaction dynamic model has been trained with a few initial experiments (30 initial experiments). In addition, the possibility to keep the learning of the human-robot interaction dynamics active allows accounting for the adaptation of human motor system.

A Human–Robot Collaboration Controller Utilizing Confidence for Disagreement Adjustment

Beyond End-Effector: Utilizing High-Resolution Tactile Signals for Physical Human–Robot Interaction

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

Intention-Driven Variable Impedance Control for Physical Human-Robot Interaction

Human–Robot Shared Control Based on Locally Weighted Intent Prediction for a Teleoperated Hydraulic Manipulator System

Proactive Robot Control for Collaborative Manipulation Using Human Intent

A Motion Control Approach for Physical Human–Robot-Environment Interaction Via Operational Behaviors Inference

Direction-Constrained Control for Efficient Physical Human-Robot Interaction under Hierarchical Tasks

Estimation of Human Impedance and Motion Intention for Constrained Human-Robot Interaction.

Physical Human-Robot Interaction Control of an Upper Limb Exoskeleton with a Decentralized Neuro-Adaptive Control Scheme

Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration

Human–Robot Collaboration Based on Motion Intention Estimation

Neuroadaptation in Physical Human-Robot Collaboration

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Efficient and Safe Contact-rich pHRI via Subtask Detection and Motion Estimation using Deep Learning

Adaptive Human-Robot Collaboration Control Based on Optimal Admittance Parameters

Learning-based Adaptive Optimal Impedance Control to Enhance Physical Human-robot Interaction Performance

Adaptive impedance control with trajectory adaptation for minimizing interaction force

Decentralized approximated optimal control for modular robot manipulations with physical human–robot interaction: a cooperative game-based strategy

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information

An Efficient and Responsive Robot Motion Controller for Safe Human-Robot Collaboration