Abstract:Objective: This study aims to improve workers' postures and thus reduce the risk of musculoskeletal disorders in human-robot collaboration by developing a novel model-free reinforcement learning method. Background: Human-robot collaboration has been a flourishing work configuration in recent years. Yet, it could lead to work-related musculoskeletal disorders if the collaborative tasks result in awkward postures for workers. Methods: The proposed approach follows two steps: first, a 3D human skeleton reconstruction method was adopted to calculate workers' continuous awkward posture (CAP) score; second, an online gradient-based reinforcement learning algorithm was designed to dynamically improve workers' CAP score by adjusting the positions and orientations of the robot end effector. Results: In an empirical experiment, the proposed approach can significantly improve the CAP scores of the participants during a human-robot collaboration task when compared with the scenarios where robot and participants worked together at a fixed position or at the individual elbow height. The questionnaire outcomes also showed that the working posture resulted from the proposed approach was preferred by the participants. Conclusion: The proposed model-free reinforcement learning method can learn the optimal worker postures without the need for specific biomechanical models. The data-driven nature of this method can make it adaptive to provide personalized optimal work posture. Application: The proposed method can be applied to improve the occupational safety in robot-implemented factories. Specifically, the personalized robot working positions and orientations can proactively reduce exposure to awkward postures that increase the risk of musculoskeletal disorders. The algorithm can also reactively protect workers by reducing the workload in specific joints.

Toward Safe Human-Robot Interaction: More Efficient Safety Monitoring Technology For Robotic Arms

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

A Smooth Velocity Transition Framework Based on Hierarchical Proximity Sensing for Safe Human-Robot Interaction

Active Collision Avoidance for Human-Manipulator Safety

An Active Strategy for Safe Human–Robot Interaction Based on Visual–Tactile Perception

IoT-Enabled Robot Skin System for Enhancement of Safe Human-Robot Interaction

User-Interactive Robot Skin with Large-Area Scalability for Safer and Natural Human-Robot Collaboration in Future Telehealthcare

Improving Workers' Musculoskeletal Health During Human-Robot Collaboration Through Reinforcement Learning

Dynamic Risk Assessment and Active Response Strategy for Industrial Human-Robot Collaboration

Towards Safe Multi-Level Human-Robot Interaction in Industrial Tasks

Multi-Joint Active Collision Avoidance for Robot Based on Depth Visual Perception

Online Collision Avoidance for Human-Robot Collaborative Interaction Concerning Safety and Efficiency

Whole-Body Teleoperation Control of Dual-Arm Robot Using Sensor Fusion

A Safe Human–robot Interactive Control Structure with Human Arm Movement Detection for an Upper-Limb Wearable Robot Used During Lifting Tasks

Sensor Fusion Based Humanoid Robotic arm Control*

Visual Attention Based Cognitive Human-Robot Collaboration for Pedicle Screw Placement in Robot-Assisted Orthopedic Surgery

A Context-Aware Safety System for Human-Robot Collaboration

Robot Arm Safety Improvement by Position/Torque Switching Control

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

Towards safe robot-human collaboration systems using human pose detection

Enhanced robot obstacle avoidance strategy: efficient distance estimation and collision avoidance for hidden robots