Abstract:Purpose Workers' unsafe behavior is the main cause of construction safety accidents, thereby highlighting the critical importance of behavior-based management. To compensate for the limitations of computer vision in tackling knowledge-intensive issues, semantic-based methods have gained increasing attention in the field of construction safety management. Knowledge graph provides an efficient and visualized method for the identification of various unsafe behaviors. Design/methodology/approach This study proposes an unsafe behavior identification framework by integrating computer vision and knowledge graph–based reasoning. An enhanced ontology model anchors our framework, with image features from YOLOv5, COCO Panoptic Segmentation and DeepSORT integrated into the graph database, culminating in a structured knowledge graph. An inference module is also developed, enabling automated the extraction of unsafe behavior knowledge through rule-based reasoning. Findings A case application is implemented to demonstrate the feasibility and effectiveness of the proposed method. Results show that the method can identify various unsafe behaviors from images of construction sites and provide mitigation recommendations for safety managers by automated reasoning, thus supporting on-site safety management and safety education. Originality/value Existing studies focus on spatial relationships, often neglecting the diversified spatiotemporal information in images. Besides, previous research in construction safety only partially automated knowledge graph construction and reasoning processes. In contrast, this study constructs an enhanced knowledge graph integrating static and dynamic data, coupled with an inference module for fully automated knowledge-based unsafe behavior identification. It can help managers grasp the workers' behavior dynamics and timely implement measures to correct violations.

Ontology-Based Knowledge Modeling for Automated Construction Safety Checking

BIM-enabled semantic web for automated safety checks in subway construction

Ontology-Based Semantic Modeling of Knowledge in Construction: Classification and Identification of Hazards Implied in Images

Knowledge-informed semantic alignment and rule interpretation for automated compliance checking

Automated compliance checking for BIM models based on Chinese-NLP and knowledge graph: an integrative conceptual framework

Safety Risk Management of Prefabricated Building Construction Based on Ontology Technology in the BIM Environment

Compliance Checking on Topological Spatial Relationships of Building Elements Based on Building Information Models and Ontology

Unsafe behavior identification on construction sites by combining computer vision and knowledge graph–based reasoning

Intelligent Checking Method for Construction Schemes via Fusion of Knowledge Graph and Large Language Models

Research on ontology-based construction risk knowledge base development in deep foundation pit excavation

Research on Unsafe Behavior of Construction Workers Under the Bidirectional Effect of Formal Rule Awareness and Conformity Mentality

University of Huddersfield Repository Construction risk knowledge management in BIM using ontology and semantic web technology

Developing A Case-Based Reasoning Model for Safety Accident Pre-Control and Decision Making in the Construction Industry

Modeling System Safety Requirements Using Input/Output Constraint Meta-Automata

Compliance checking approach for BIM structural model under semantic web

Geotechnical and Safety Protective Equipment Planning Using Range Point Cloud Data and Rule Checking in Building Information Modeling

Automated Building Information Modeling Compliance Check Through a Large Language Model Combined with Deep Learning and Ontology

Automatic Compliance Checking of BIM Models Against Quality Standards Based on Ontology Technology

Ontology-Based Semantic Modeling of Coal Mine Roof Caving Accidents

Semantic web based rule checking of real-world scale BIM models : a pragmatic method

Development of process safety knowledge graph: A Case study on delayed coking process