Abstract:Objective: This study aims to improve workers' postures and thus reduce the risk of musculoskeletal disorders in human-robot collaboration by developing a novel model-free reinforcement learning method. Background: Human-robot collaboration has been a flourishing work configuration in recent years. Yet, it could lead to work-related musculoskeletal disorders if the collaborative tasks result in awkward postures for workers. Methods: The proposed approach follows two steps: first, a 3D human skeleton reconstruction method was adopted to calculate workers' continuous awkward posture (CAP) score; second, an online gradient-based reinforcement learning algorithm was designed to dynamically improve workers' CAP score by adjusting the positions and orientations of the robot end effector. Results: In an empirical experiment, the proposed approach can significantly improve the CAP scores of the participants during a human-robot collaboration task when compared with the scenarios where robot and participants worked together at a fixed position or at the individual elbow height. The questionnaire outcomes also showed that the working posture resulted from the proposed approach was preferred by the participants. Conclusion: The proposed model-free reinforcement learning method can learn the optimal worker postures without the need for specific biomechanical models. The data-driven nature of this method can make it adaptive to provide personalized optimal work posture. Application: The proposed method can be applied to improve the occupational safety in robot-implemented factories. Specifically, the personalized robot working positions and orientations can proactively reduce exposure to awkward postures that increase the risk of musculoskeletal disorders. The algorithm can also reactively protect workers by reducing the workload in specific joints.

Virtual data generation for human intention prediction based on digital modeling of human-robot collaboration

Human-robot Negotiation of Intentions Based on Virtual Fixtures for Shared Task Execution

A Vision-based Human Digital Twin Modelling Approach for Adaptive Human-Robot Collaboration

Enabling collaborative assembly between humans and robots using a digital twin system

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Construction of Human Digital Twin Model Based on Multimodal Data and Its Application in Locomotion Mode Identification

A Vision-Based Measure of Environmental Effects on Inferring Human Intention During Human Robot Interaction

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

A human digital twin approach for fatigue-aware task planning in human-robot collaborative assembly

Workspace Optimization Techniques to Improve Prediction of Human Motion During Human-Robot Collaboration

Integrating digital human modeling into virtual environment for ergonomic oriented design

Digital Twin-Driven Human Robot Collaboration Using a Digital Human

Bayesian Intention for Enhanced Human Robot Collaboration

Human-robot collaboration assembly personalised safety detection method based on digital twin

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

Toward Proactive Human–Robot Collaborative Assembly: A Multimodal Transfer-Learning-Enabled Action Prediction Approach

Improving Workers' Musculoskeletal Health During Human-Robot Collaboration Through Reinforcement Learning

A Virtual Human Model for Ergonomics Workplace Design

A digital twin-driven human–robot collaborative assembly-commissioning method for complex products

A Hybrid Human Motion Prediction Approach For Human-Robot Collaboration

Benchmarking Adaptive Intelligence and Computer Vision on Human-Robot Collaboration