Abstract:The construction industry is accident-prone, and unsafe behaviors of construction workers have been identified as a leading cause of accidents. One important countermeasure to prevent accidents is monitoring and managing those unsafe behaviors. The most popular way of detecting and identifying workers' unsafe behaviors is the computer vision-based intelligent monitoring system. However, most of the existing research or products focused only on the workers' behaviors (i.e., motions) recognition, limited studies considered the interaction between man-machine, man-material or man-environments. Those interactions are very important for judging whether the workers' behaviors are safe or not, from the standpoint of safety management. This study aims to develop a new method of identifying construction workers' unsafe behaviors, i.e., unsafe interaction between man-machine/material, based on ST-GCN (Spatial Temporal Graph Convolutional Networks) and YOLO (You Only Look Once), which could provide more direct and valuable information for safety management. In this study, two trained YOLO-based models were, respectively, used to detect safety signs in the workplace, and objects that interacted with workers. Then, an ST-GCN model was trained to detect and identify workers' behaviors. Lastly, a decision algorithm was developed considering interactions between man-machine/material, based on YOLO and ST-GCN results. Results show good performance of the developed method, compared to only using ST-GCN, the accuracy was significantly improved from 51.79% to 85.71%, 61.61% to 99.11%, and 58.04% to 100.00%, respectively, in the identification of the following three kinds of behaviors, throwing (throwing hammer, throwing bottle), operating (turning on switch, putting bottle), and crossing (crossing railing and crossing obstacle). The findings of the study have some practical implications for safety management, especially workers' behavior monitoring and management.

Human risky behaviour recognition during ladder climbing based on multi-modal feature fusion and adaptive graph convolutional network

Deep Learning Based Abnormal Behavior Detection for Elderly Healthcare Using Consumer Network Cameras

Real-time monitoring unsafe behaviors of portable multi-position ladder worker using deep learning based on vision data

Action Recognition Based on 3D Skeleton and LSTM for the Monitoring of Construction Workers’ Safety Harness Usage

Computer vision and long short-term memory: Learning to predict unsafe behaviour in construction

A Real-time Fall Detection System Using ToF Depth Images.

Worker Abnormal Behavior Recognition Based on Spatio-Temporal Graph Convolution and Attention Model

Image-and-Skeleton-Based Parameterized Approach to Real-Time Identification of Construction Workers' Unsafe Behaviors

Recognition of abnormal human behavior in dual-channel convolutional 3D construction site based on deep learning

Analysis of Stadium Operation Risk Warning Model Based on Deep Confidence Neural Network Algorithm

Fall Detection Method for Infrared Videos Based on Spatial-Temporal Graph Convolutional Network

Real-time monitoring of work-at-height safety hazards in construction sites using drones and deep learning

Real-Time Early Safety Warning for Personnel Intrusion Behavior on Construction Sites Using a CNN Model

Human risk recognition and prediction in manned submersible diving tasks driven by deep learning models

An Unsafe Behavior Detection Method Based on Improved YOLO Framework

YOLOv5s-gnConv: detecting personal protective equipment for workers at height

Multi-level Recognition on Falls from Activities of Daily Living

FALLNET: A Deep Learning Model for Fall Detection using improved CNN-Attention-LSTM

Fall Detection with CNN-Casual LSTM Network

Study on the Interaction Behaviors Identification of Construction Workers Based on ST-GCN and YOLO