Abstract:Purpose Workers' unsafe behavior is the main cause of construction safety accidents, thereby highlighting the critical importance of behavior-based management. To compensate for the limitations of computer vision in tackling knowledge-intensive issues, semantic-based methods have gained increasing attention in the field of construction safety management. Knowledge graph provides an efficient and visualized method for the identification of various unsafe behaviors. Design/methodology/approach This study proposes an unsafe behavior identification framework by integrating computer vision and knowledge graph–based reasoning. An enhanced ontology model anchors our framework, with image features from YOLOv5, COCO Panoptic Segmentation and DeepSORT integrated into the graph database, culminating in a structured knowledge graph. An inference module is also developed, enabling automated the extraction of unsafe behavior knowledge through rule-based reasoning. Findings A case application is implemented to demonstrate the feasibility and effectiveness of the proposed method. Results show that the method can identify various unsafe behaviors from images of construction sites and provide mitigation recommendations for safety managers by automated reasoning, thus supporting on-site safety management and safety education. Originality/value Existing studies focus on spatial relationships, often neglecting the diversified spatiotemporal information in images. Besides, previous research in construction safety only partially automated knowledge graph construction and reasoning processes. In contrast, this study constructs an enhanced knowledge graph integrating static and dynamic data, coupled with an inference module for fully automated knowledge-based unsafe behavior identification. It can help managers grasp the workers' behavior dynamics and timely implement measures to correct violations.

Skeleton-based Automatic Assessment and Prediction of Intrusion Risk in Construction Hazardous Areas

Improved Vision-Based Method for Detection of Unauthorized Intrusion by Construction Sites Workers

Image-and-Skeleton-Based Parameterized Approach to Real-Time Identification of Construction Workers' Unsafe Behaviors

Computer vision and long short-term memory: Learning to predict unsafe behaviour in construction

Motion Recognition Method for Construction Workers Using Selective Depth Inspection and Optimal Inertial Measurement Unit Sensors

Applications of Computer Vision in Monitoring the Unsafe Behavior of Construction Workers: Current Status and Challenges

Action Recognition Based on 3D Skeleton and LSTM for the Monitoring of Construction Workers’ Safety Harness Usage

Unsafe behavior identification on construction sites by combining computer vision and knowledge graph–based reasoning

Human risky behaviour recognition during ladder climbing based on multi-modal feature fusion and adaptive graph convolutional network

Joint-Level Vision-Based Ergonomic Assessment Tool for Construction Workers

An Experimental Study of Real-Time Identification of Construction Workers' Unsafe Behaviors

AR-Facilitated Safety Inspection and Fall Hazard Detection on Construction Sites

Visual Detection of Personal Protective Equipment and Safety Gear on Industry Workers

Monocular 2D Camera-based Proximity Monitoring for Human-Machine Collision Warning on Construction Sites

Detecting potential falling objects by inferring human action and natural disturbance

Real-Time Early Safety Warning for Personnel Intrusion Behavior on Construction Sites Using a CNN Model

Safety Risk Prediction Model of High-Rise Building Construction Based on Key Physiological Index

Automated Kinect-based posture evaluation method for work-related musculoskeletal disorders of construction workers

A Target Detection and Evaluation Method for Safety Protection Equipment

Environment-Aware Worker Trajectory Prediction Using Surveillance Camera in Modular Construction Facilities

A GRU-Based Model for Detecting Common Accidents of Construction Workers