Abstract:Industry 4.0 is taking human-robot collaboration at the center of the production environment. Collaborative robots enhance productivity and flexibility while reducing human's fatigue and the risk of injuries, exploiting advanced control methodologies. However, there is a lack of real-time model-based controllers accounting for the complex human-robot interaction dynamics. With this aim, this paper proposes a Model-Based Reinforcement Learning (MBRL) variable impedance controller to assist human operators in collaborative tasks. More in details, an ensemble of Artificial Neural Networks (ANNs) is used to learn a human-robot interaction dynamic model, capturing uncertainties. Such a learned model is kept updated during collaborative tasks execution. In addition, the learned model is used by a Model Predictive Controller (MPC) with Cross-Entropy Method (CEM). The aim of the MPC+CEM is to online optimize the stiffness and damping impedance control parameters minimizing the human effort (i.e, minimizing the human-robot interaction forces). The proposed approach has been validated through an experimental procedure. A lifting task has been considered as the reference validation application (weight of the manipulated part: 10 kg unknown to the robot controller). A KUKA LBR iiwa 14 R820 has been used as a test platform. Qualitative performance (i.e, questionnaire on perceived collaboration) have been evaluated. Achieved results have been compared with previous developed offline model-free optimized controllers and with the robot manual guidance controller. The proposed MBRL variable impedance controller shows improved human-robot collaboration. The proposed controller is capable to actively assist the human in the target task, compensating for the unknown part weight. The human-robot interaction dynamic model has been trained with a few initial experiments (30 initial experiments). In addition, the possibility to keep the learning of the human-robot interaction dynamics active allows accounting for the adaptation of human motor system.

A neural network-based approach for variable admittance control in human–robot cooperation: online adjustment of the virtual inertia

A recurrent neural network for variable admittance control in human–robot cooperation: simultaneously and online adjustment of the virtual damping and Inertia parameters

Variable Force Tracking Control Via Online Learning

Learning Variable Admittance Control for Human-Robot Collaborative Manipulation

Adaptive Human-Robot Collaboration Control Based on Optimal Admittance Parameters

Fuzzy variable impedance-based adaptive neural network control in physical human–robot interaction

Iterative Learning Control Of Varying Trajectories For Robot Manipulators

Neural Networks Enhanced Adaptive Admittance Control of Optimized Robot–Environment Interaction

Variable admittance control for safe physical human–robot interaction considering intuitive human intention

Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration

Adaptive Neural-Network Boundary Control for a Flexible Manipulator with Input Constraints and Model Uncertainties

Dynamical system based variable admittance control for physical human-robot interaction

Neural-learning-enhanced Cartesian Admittance Control of Robot with Moving RCM Constraints.

Online-Learning Deep Neuro-Adaptive Dynamic Inversion Controller for Model Free Control

Adaptive Neural Control for Robotic Manipulators With Output Constraints and Uncertainties

A neural network based framework for variable impedance skills learning from demonstrations

Control of robot manipulators with uncertain closed architecture using neural networks

A variable admittance control strategy for stable physical human–robot interaction

Neural Adaptive Impedance Control for Force Tracking in Uncertain Environment

Neural network-based variable stiffness impedance control for internal/external forces tracking of dual-arm manipulators under uncertainties

Adaptive Neural Network Control for a Lower-Limb Exoskeleton Using Variable Stiffness Transferring