Abstract:Industry 4.0 is taking human-robot collaboration at the center of the production environment. Collaborative robots enhance productivity and flexibility while reducing human's fatigue and the risk of injuries, exploiting advanced control methodologies. However, there is a lack of real-time model-based controllers accounting for the complex human-robot interaction dynamics. With this aim, this paper proposes a Model-Based Reinforcement Learning (MBRL) variable impedance controller to assist human operators in collaborative tasks. More in details, an ensemble of Artificial Neural Networks (ANNs) is used to learn a human-robot interaction dynamic model, capturing uncertainties. Such a learned model is kept updated during collaborative tasks execution. In addition, the learned model is used by a Model Predictive Controller (MPC) with Cross-Entropy Method (CEM). The aim of the MPC+CEM is to online optimize the stiffness and damping impedance control parameters minimizing the human effort (i.e, minimizing the human-robot interaction forces). The proposed approach has been validated through an experimental procedure. A lifting task has been considered as the reference validation application (weight of the manipulated part: 10 kg unknown to the robot controller). A KUKA LBR iiwa 14 R820 has been used as a test platform. Qualitative performance (i.e, questionnaire on perceived collaboration) have been evaluated. Achieved results have been compared with previous developed offline model-free optimized controllers and with the robot manual guidance controller. The proposed MBRL variable impedance controller shows improved human-robot collaboration. The proposed controller is capable to actively assist the human in the target task, compensating for the unknown part weight. The human-robot interaction dynamic model has been trained with a few initial experiments (30 initial experiments). In addition, the possibility to keep the learning of the human-robot interaction dynamics active allows accounting for the adaptation of human motor system.

On Human Machine Cooperative Learning Control

A Review of Human-Machine Cooperation in the Robotics Domain

Learning control strategy based on human-machine on-line cooperation

Reinforcement Learning for Human-Robot Shared Control

Learning Human Behavior in Shared Control: Adaptive Inverse Differential Game Approach

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Switching Learning-Based Cooperative Control with Its Application to Connected Automated Vehicles

Model Construction and Cooperative Control in VR

Toward Adaptive Cooperation: Model-Based Shared Control Using LQ-Differential Games

Human-Machine Plan Conflict and Conflict Resolution in a Visual Search Task

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

Cooperative control of dual-arm robots in different human-robot collaborative tasks

A self‐learning human‐machine cooperative control method based on driver intention recognition

Model‐free learning‐based distributed cooperative tracking control of human‐in‐the‐loop multi‐agent systems

A Survey of Human-in-the-loop for Machine Learning

Human Machine Co-adaption Interface via Cooperation Markov Decision Process System

Joining the blunt and the pointy end of the spear: towards a common framework of joint action, human–machine cooperation, cooperative guidance and control, shared, traded and supervisory control

On Man-machine Integration and Intelligent Control of Complex Systems

Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information

A Learning-Based Hierarchical Control Scheme for an Exoskeleton Robot in Human-Robot Cooperative Manipulation.