Ergonomic Optimization in Worker-Robot Bimanual Object Handover: Implementing REBA Using Reinforcement Learning in Virtual Reality

Mani Amani,Reza Akhavian
2024-03-19
Abstract:Robots can serve as safety catalysts on construction job sites by taking over hazardous and repetitive tasks while alleviating the risks associated with existing manual workflows. Research on the safety of physical human-robot interaction (pHRI) is traditionally focused on addressing the risks associated with potential collisions. However, it is equally important to ensure that the workflows involving a collaborative robot are inherently safe, even though they may not result in an accident. For example, pHRI may require the human counterpart to use non-ergonomic body postures to conform to the robot hardware and physical configurations. Frequent and long-term exposure to such situations may result in chronic health issues. Safety and ergonomics assessment measures can be understood by robots if they are presented in algorithmic fashions so optimization for body postures is attainable. While frameworks such as Rapid Entire Body Assessment (REBA) have been an industry standard for many decades, they lack a rigorous mathematical structure which poses challenges in using them immediately for pHRI safety optimization purposes. Furthermore, learnable approaches have limited robustness outside of their training data, reducing generalizability. In this paper, we propose a novel framework that approaches optimization through Reinforcement Learning, ensuring precise, online ergonomic scores as compared to approximations, while being able to generalize and tune the regiment to any human and any task. To ensure practicality, the training is done in virtual reality utilizing Inverse Kinematics to simulate human movement mechanics. Experimental findings are compared to ergonomically naive object handover heuristics and indicate promising results where the developed framework can find the optimal object handover coordinates in pHRI contexts for manual material handling exemplary situations.
Robotics
What problem does this paper attempt to address?
The paper attempts to address the issue of optimizing ergonomic assessment during dual-arm object handover in human-robot collaboration (physical human-robot interaction, pHRI). Specifically, the main objectives of the study include: 1. **Addressing the non-differentiability issue of REBA scores**: REBA (Rapid Entire Body Assessment) is a widely used industrial standard for evaluating the ergonomic safety of tasks, but its discrete scoring system makes the automation of the optimization process difficult. 2. **Optimization method without the need for actual data collection**: Avoiding the data collection challenges caused by constantly changing object positions during the training process. 3. **Developing a reinforcement learning-based framework**: Utilizing reinforcement learning algorithms to find the optimal dual-arm object handover position in a virtual reality environment, ensuring ergonomic safety, and making the framework adaptable to any task and any worker. Through these efforts, the paper aims to propose a new method to optimize object handover positions in pHRI within industrial environments, thereby reducing work-related musculoskeletal disorders (WMSDs), and improving work efficiency and safety.