Abstract:Industry 4.0 is taking human-robot collaboration at the center of the production environment. Collaborative robots enhance productivity and flexibility while reducing human's fatigue and the risk of injuries, exploiting advanced control methodologies. However, there is a lack of real-time model-based controllers accounting for the complex human-robot interaction dynamics. With this aim, this paper proposes a Model-Based Reinforcement Learning (MBRL) variable impedance controller to assist human operators in collaborative tasks. More in details, an ensemble of Artificial Neural Networks (ANNs) is used to learn a human-robot interaction dynamic model, capturing uncertainties. Such a learned model is kept updated during collaborative tasks execution. In addition, the learned model is used by a Model Predictive Controller (MPC) with Cross-Entropy Method (CEM). The aim of the MPC+CEM is to online optimize the stiffness and damping impedance control parameters minimizing the human effort (i.e, minimizing the human-robot interaction forces). The proposed approach has been validated through an experimental procedure. A lifting task has been considered as the reference validation application (weight of the manipulated part: 10 kg unknown to the robot controller). A KUKA LBR iiwa 14 R820 has been used as a test platform. Qualitative performance (i.e, questionnaire on perceived collaboration) have been evaluated. Achieved results have been compared with previous developed offline model-free optimized controllers and with the robot manual guidance controller. The proposed MBRL variable impedance controller shows improved human-robot collaboration. The proposed controller is capable to actively assist the human in the target task, compensating for the unknown part weight. The human-robot interaction dynamic model has been trained with a few initial experiments (30 initial experiments). In addition, the possibility to keep the learning of the human-robot interaction dynamics active allows accounting for the adaptation of human motor system.

Human-robot cooperation for robust surface treatment using non-conventional sliding mode control

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

Beyond End-Effector: Utilizing High-Resolution Tactile Signals for Physical Human–Robot Interaction

Human-Robot Collaboration for Unknown Flexible Surface Exploration and Treatment Based on Mesh Iterative Learning Control.

Non-linear Sliding Mode Control of the Lower Extremity Exoskeleton Based on Human–robot Cooperation

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information

Haptic and Visual Feedback Assistance for Dual-Arm Robot Teleoperation in Surface Conditioning Tasks

Compliant Human-Robot Object Transfer Based on Modular 3-Axis Force Sensor for Collaborative Manufacturing.

A Force Control Method Integrating Human Skills for Complex Surface Finishing

A Novel Robust Finite-Time Trajectory Control with the High-Order Sliding Mode for Human–Robot Cooperation

Toward Optimal Robot Machining Considering the Workpiece Surface Geometry in a Task-Oriented Approach

Collaborative Bimanual Manipulation Using Optimal Motion Adaptation and Interaction Control

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Reactive human–robot collaborative manipulation of deformable linear objects using a new topological latent control model

Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration

Human-Manipulator Interface Using Hybrid Sensors Via CMAC for Dual Robots.

A Laser-based Dual-arm System for Precise Control of Collaborative Robots

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Towards Human-Robot Collaborative Surgery: Trajectory and Strategy Learning in Bimanual Peg Transfer

RoboGrind: Intuitive and Interactive Surface Treatment with Industrial Robots

Efficient and Safe Contact-rich pHRI via Subtask Detection and Motion Estimation using Deep Learning