Abstract:Industry 4.0 is taking human-robot collaboration at the center of the production environment. Collaborative robots enhance productivity and flexibility while reducing human's fatigue and the risk of injuries, exploiting advanced control methodologies. However, there is a lack of real-time model-based controllers accounting for the complex human-robot interaction dynamics. With this aim, this paper proposes a Model-Based Reinforcement Learning (MBRL) variable impedance controller to assist human operators in collaborative tasks. More in details, an ensemble of Artificial Neural Networks (ANNs) is used to learn a human-robot interaction dynamic model, capturing uncertainties. Such a learned model is kept updated during collaborative tasks execution. In addition, the learned model is used by a Model Predictive Controller (MPC) with Cross-Entropy Method (CEM). The aim of the MPC+CEM is to online optimize the stiffness and damping impedance control parameters minimizing the human effort (i.e, minimizing the human-robot interaction forces). The proposed approach has been validated through an experimental procedure. A lifting task has been considered as the reference validation application (weight of the manipulated part: 10 kg unknown to the robot controller). A KUKA LBR iiwa 14 R820 has been used as a test platform. Qualitative performance (i.e, questionnaire on perceived collaboration) have been evaluated. Achieved results have been compared with previous developed offline model-free optimized controllers and with the robot manual guidance controller. The proposed MBRL variable impedance controller shows improved human-robot collaboration. The proposed controller is capable to actively assist the human in the target task, compensating for the unknown part weight. The human-robot interaction dynamic model has been trained with a few initial experiments (30 initial experiments). In addition, the possibility to keep the learning of the human-robot interaction dynamics active allows accounting for the adaptation of human motor system.

Mutualistic and Adaptive Human-Machine Collaboration Based on Machine Learning in an Injection Moulding Manufacturing Line

Human-centric Manufacturing for Human-System Coevolution in Industry 5.0

An adaptive human sensor framework for human–robot collaboration

FABRIC: A Framework for the Design and Evaluation of Collaborative Robots with Extended Human Adaptation

Towards Modern Inclusive Factories: A Methodology for the Development of Smart Adaptive Human-Machine Interfaces

Ergonomic Design of an Adaptive Automation Assembly System

Humans are not Machines - Anthropocentric Human-Machine Symbiosis for Ultra-Flexible Smart Manufacturing

Real-Time Adaptive Industrial Robots: Improving Safety And Comfort In Human-Robot Collaboration

A non-intrusive Industry 4.0 retrofitting approach for collaborative maintenance in traditional manufacturing

Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration

Benchmarking Adaptive Intelligence and Computer Vision on Human-Robot Collaboration

MATE robots simplifying my work: benefits and socio-ethical implications

Surrogate Modelling for Injection Molding Processes using Machine Learning

Design and Prototyping of a Collaborative Station for Machine Parts Assembly

Symbiotic human–robot collaborative approach for increased productivity and enhanced safety in the aerospace manufacturing industry

Designing intelligent manufacturing systems through Human-Machine Cooperation principles: A human-centered approach

Human Robot Collaboration for Enhancing Work Activities.

Machine learning in intelligent manufacturing system for optimization of production costs and overall effectiveness of equipment in fabrication models

Human Machine Co-adaption Interface via Cooperation Markov Decision Process System

Design of Human-Machine Integration System to Meet Diverse Interactive Tasks

Seamless Human–Robot Collaborative Assembly Using Artificial Intelligence and Wearable Devices