Abstract:PurposeFall accidents can cause casualties and economic losses in the construction industry. Fall portents, such as loss of balance (LOB) and sudden sways, can result in fatal, nonfatal or attempted fall accidents. All of them are worthy of studying to take measures to prevent future accidents. Detecting fall portents can proactively and comprehensively help managers assess the risk to workers as well as in the construction environment and further prevent fall accidents.Design/methodology/approachThis study focused on the postures of workers and aimed to directly detect fall portents using a computer vision (CV)-based noncontact approach. Firstly, a joint coordinate matrix generated from a three-dimensional pose estimation model is employed, and then the matrix is preprocessed by principal component analysis, K-means and pre-experiments. Finally, a modified fusion K-nearest neighbor-based machine learning model is built to fuse information from the x, y and z axes and output the worker's pose status into three stages.FindingsThe proposed model can output the worker's pose status into three stages (steady-unsteady-fallen) and provide corresponding confidence probabilities for each category. Experiments conducted to evaluate the approach show that the model accuracy reaches 85.02% with threshold-based postprocessing. The proposed fall-portent detection approach can extract the fall risk of workers in the both pre- and post-event phases based on noncontact approach.Research limitations/implicationsFirst, three-dimensional (3D) pose estimation needs sufficient information, which means it may not perform well when applied in complicated environments or when the shooting distance is extremely large. Second, solely focusing on fall-related factors may not be comprehensive enough. Future studies can incorporate the results of this research as an indicator into the risk assessment system to achieve a more comprehensive and accurate evaluation of worker and site risk.Practical implicationsThe proposed machine learning model determines whether the worker is in a status of steady, unsteady or fallen using a CV-based approach. From the perspective of construction management, when detecting fall-related actions on construction sites, the noncontact approach based on CV has irreplaceable advantages of no interruption to workers and low cost. It can make use of the surveillance cameras on construction sites to recognize both preceding events and happened accidents. The detection of fall portents can help worker risk assessment and safety management.Originality/valueExisting studies using sensor-based approaches are high-cost and invasive for construction workers, and others using CV-based approaches either oversimplify by binary classification of the non-entire fall process or indirectly achieve fall-portent detection. Instead, this study aims to detect fall portents directly by worker's posture and divide the entire fall process into three stages using a CV-based noncontact approach. It can help managers carry out more comprehensive risk assessment and develop preventive measures.

Falling Objects Detection for Near Miss Incidents Identification on Construction Site

Fall-portent Detection for Construction Sites Based on Computer Vision and Machine Learning

A Sensor-Based Method to Detect Near-Miss Struck-By on Construction Site

Real-time monitoring of work-at-height safety hazards in construction sites using drones and deep learning

A Deep Learning-Based Approach for Mitigating Falls from Height with Computer Vision: Convolutional Neural Network.

Computer Vision Aided Inspection on Falling Prevention Measures for Steeplejacks in an Aerial Environment

Using Smartphones to Detect and Identify Construction Workers' Near-Miss Falls Based on ANN

Few-shot object detection and attribute recognition from construction site images for improved field compliance

Construction Site Safety Management: A Computer Vision and Deep Learning Approach

A Deep Learning-Based Method for Detecting Non-Certified Work on Construction Sites

Human Intrusion Detection in Static Hazardous Areas at Construction Sites: Deep Learning–Based Method

A Study Of Using Smartphone To Detect And Identify Construction Workers' Near-Miss Falls Based On Ann

A Real-time Fall Detection System Using ToF Depth Images.

Research On Near Miss Monitoring System On The Subway Construction Site

Deep learning‐based object identification with instance segmentation and pseudo‐LiDAR point cloud for work zone safety

Standardized Use Inspection of Workers' Personal Protective Equipment Based on Deep Learning

Detecting Non-Hardhat-use by a Deep Learning Method from Far-Field Surveillance Videos

Real-time monitoring unsafe behaviors of portable multi-position ladder worker using deep learning based on vision data

A GRU-Based Model for Detecting Common Accidents of Construction Workers

Deep Learning-Based Safety Helmet Detection in Engineering Management Based on Convolutional Neural Networks

Monocular 2D Camera-based Proximity Monitoring for Human-Machine Collision Warning on Construction Sites