Abstract:PurposeFall accidents can cause casualties and economic losses in the construction industry. Fall portents, such as loss of balance (LOB) and sudden sways, can result in fatal, nonfatal or attempted fall accidents. All of them are worthy of studying to take measures to prevent future accidents. Detecting fall portents can proactively and comprehensively help managers assess the risk to workers as well as in the construction environment and further prevent fall accidents.Design/methodology/approachThis study focused on the postures of workers and aimed to directly detect fall portents using a computer vision (CV)-based noncontact approach. Firstly, a joint coordinate matrix generated from a three-dimensional pose estimation model is employed, and then the matrix is preprocessed by principal component analysis, K-means and pre-experiments. Finally, a modified fusion K-nearest neighbor-based machine learning model is built to fuse information from the x, y and z axes and output the worker's pose status into three stages.FindingsThe proposed model can output the worker's pose status into three stages (steady-unsteady-fallen) and provide corresponding confidence probabilities for each category. Experiments conducted to evaluate the approach show that the model accuracy reaches 85.02% with threshold-based postprocessing. The proposed fall-portent detection approach can extract the fall risk of workers in the both pre- and post-event phases based on noncontact approach.Research limitations/implicationsFirst, three-dimensional (3D) pose estimation needs sufficient information, which means it may not perform well when applied in complicated environments or when the shooting distance is extremely large. Second, solely focusing on fall-related factors may not be comprehensive enough. Future studies can incorporate the results of this research as an indicator into the risk assessment system to achieve a more comprehensive and accurate evaluation of worker and site risk.Practical implicationsThe proposed machine learning model determines whether the worker is in a status of steady, unsteady or fallen using a CV-based approach. From the perspective of construction management, when detecting fall-related actions on construction sites, the noncontact approach based on CV has irreplaceable advantages of no interruption to workers and low cost. It can make use of the surveillance cameras on construction sites to recognize both preceding events and happened accidents. The detection of fall portents can help worker risk assessment and safety management.Originality/valueExisting studies using sensor-based approaches are high-cost and invasive for construction workers, and others using CV-based approaches either oversimplify by binary classification of the non-entire fall process or indirectly achieve fall-portent detection. Instead, this study aims to detect fall portents directly by worker's posture and divide the entire fall process into three stages using a CV-based noncontact approach. It can help managers carry out more comprehensive risk assessment and develop preventive measures.

Using Smartphones to Detect and Identify Construction Workers' Near-Miss Falls Based on ANN

Human Fall Detection Improvement Based on Artificial Neural Network and Optimized Zero Moment Point Algorithms

A smartphone-based online system for fall detection with alert notifications and contextual information of real-life falls

A Effective Feature Construction Method for Fall Detection using Smartphone

A GRU-Based Model for Detecting Common Accidents of Construction Workers

Fall Detection in Individuals With Lower Limb Amputations Using Mobile Phones: Machine Learning Enhances Robustness for Real-World Applications

Fall-portent Detection for Construction Sites Based on Computer Vision and Machine Learning

A Real-Time Low-Complexity Fall Detection System on the Smartphone

Falls as anomalies? An experimental evaluation using smartphone accelerometer data

A Real-time Fall Detection System Using ToF Depth Images.

Collaborative Fall Detection Using Smart Phone and Kinect

A Sensor-Based Method to Detect Near-Miss Struck-By on Construction Site

Deep Learning-Based Near-Fall Detection Algorithm for Fall Risk Monitoring System Using a Single Inertial Measurement Unit

Fall detection using accelerometer-based smartphones: Where do we go from here?

Real-time monitoring of work-at-height safety hazards in construction sites using drones and deep learning

Fall-from-Height Detection Using Deep Learning Based on IMU Sensor Data for Accident Prevention at Construction Sites

Utilizing Computer Vision and Fuzzy Inference to Evaluate Level of Collision Safety for Workers and Equipment in a Dynamic Environment

Risk Factor Recognition for Automatic Safety Management in Construction Sites Using Fast Deep Convolutional Neural Networks

Real-time monitoring unsafe behaviors of portable multi-position ladder worker using deep learning based on vision data

Accelerometer-Based Human Fall Detection Using Convolutional Neural Networks