Abstract:Purpose Workers' unsafe behavior is the main cause of construction safety accidents, thereby highlighting the critical importance of behavior-based management. To compensate for the limitations of computer vision in tackling knowledge-intensive issues, semantic-based methods have gained increasing attention in the field of construction safety management. Knowledge graph provides an efficient and visualized method for the identification of various unsafe behaviors. Design/methodology/approach This study proposes an unsafe behavior identification framework by integrating computer vision and knowledge graph–based reasoning. An enhanced ontology model anchors our framework, with image features from YOLOv5, COCO Panoptic Segmentation and DeepSORT integrated into the graph database, culminating in a structured knowledge graph. An inference module is also developed, enabling automated the extraction of unsafe behavior knowledge through rule-based reasoning. Findings A case application is implemented to demonstrate the feasibility and effectiveness of the proposed method. Results show that the method can identify various unsafe behaviors from images of construction sites and provide mitigation recommendations for safety managers by automated reasoning, thus supporting on-site safety management and safety education. Originality/value Existing studies focus on spatial relationships, often neglecting the diversified spatiotemporal information in images. Besides, previous research in construction safety only partially automated knowledge graph construction and reasoning processes. In contrast, this study constructs an enhanced knowledge graph integrating static and dynamic data, coupled with an inference module for fully automated knowledge-based unsafe behavior identification. It can help managers grasp the workers' behavior dynamics and timely implement measures to correct violations.

Computer Vision-Based Hazard Identification of Construction Site Using Visual Relationship Detection and Ontology

Onsite Video Mining for Construction Hazards Identification with Visual Relationships

Knowledge graph for identifying hazards on construction sites: Integrating computer vision with ontology

Ontology-Based Semantic Modeling of Knowledge in Construction: Classification and Identification of Hazards Implied in Images

Improved Vision-Based Method for Detection of Unauthorized Intrusion by Construction Sites Workers

A Computer Vision-Based Approach to Classifying and Storing Image Data for Construction Safety Management

Recognition of High-Risk Scenarios in Building Construction Based on Image Semantics

Unsafe behavior identification on construction sites by combining computer vision and knowledge graph–based reasoning

Computer Vision and Deep Learning to Manage Safety in Construction: Matching Images of Unsafe Behavior and Semantic Rules

BIM-Based Dynamic Construction Safety Rule Checking Using Ontology and Natural Language Processing

Computer Vision Applications in Construction Safety Assurance

Research on computer vision application for safety management in construction

Automatic construction site hazard identification integrating construction scene graphs with BERT based domain knowledge

Intelligent Mining of Safety Hazard Information from Construction Documents Using Semantic Similarity and Information Entropy

Ontology-Based Knowledge Modeling for Automated Construction Safety Checking

A Remote-Vision-Based Safety Helmet and Harness Monitoring System Based on Attribute Knowledge Modeling

Applications of Computer Vision in Monitoring the Unsafe Behavior of Construction Workers: Current Status and Challenges

Real-time smart video surveillance to manage safety: A case study of a transport mega-project

Construction Site Hazards Identification Using Deep Learning and Computer Vision

Graph-based intelligent accident hazard ontology using natural language processing for tracking, prediction, and learning

Computer Vision for Behaviour-Based Safety in Construction: A Review and Future Directions