Real-time Robotics Situation Awareness for Accident Prevention in Industry

Juan M. Deniz,Andre S. Kelboucas,Ricardo Bedin Grando
2024-09-05
Abstract:This study explores human-robot interaction (HRI) based on a mobile robot and YOLO to increase real-time situation awareness and prevent accidents in the workplace. Using object segmentation, we propose an approach that is capable of analyzing these situations in real-time and providing useful information to avoid critical working situations. In the industry, ensuring the safety of workers is paramount, and solutions based on robots and AI can provide a safer environment. For that, we proposed a methodology evaluated with two different YOLO versions (YOLOv8 and YOLOv5) alongside a LoCoBot robot for supervision and to perform the interaction with a user. We show that our proposed approach is capable of navigating a test scenario and issuing alerts via Text-to-Speech when dangerous situations are faced, such as when hardhats and safety vests are not detected. Based on the results gathered, we can conclude that our system is capable of detecting and informing risk situations such as helmet/no helmet and safety vest/no safety vest situations.
Robotics
What problem does this paper attempt to address?
The main objective of this paper is to enhance Situation Awareness (SA) in the workplace by combining mobile robots with the YOLO (You Only Look Once) framework to prevent accidents in industrial environments. Specifically, the research team proposed a real-time object detection-based method that can analyze potential hazardous situations and provide workers with useful information to avoid high-risk work scenarios. The study utilized two different versions of the YOLO model (YOLOv8 and YOLOv5) and the LoCoBot robot for experimental validation. The system can warn workers of risks through voice prompts in situations such as not wearing a safety helmet or protective vest. Experimental results show that the system can effectively detect and report risk conditions in various scenarios, such as whether safety equipment is worn or not. Overall, this research aims to develop an automated system capable of real-time monitoring and warning of dangers, thereby enhancing worker safety in industrial environments.