Abstract:Purpose Visual inspection and human judgement form the cornerstone of daily operations and maintenance (O&M) services activities carried out by facility managers nowadays. Recent advances in technologies such as building information modelling (BIM), distributed sensor networks, augmented reality (AR) technologies and digital twins present an immense opportunity to radically improve the way daily O&M is conducted. This paper aims to describe the development of an AR-supported automated environmental anomaly detection and fault isolation method to assist facility managers in addressing problems that affect building occupants’ thermal comfort. Design/methodology/approach The developed system focusses on the detection of environmental anomalies related to the thermal comfort of occupants within a building. The performance of three anomaly detection algorithms in terms of their ability to detect indoor temperature anomalies is compared. Based on the fault tree analysis (FTA), a decision-making tree is developed to assist facility management (FM) professionals in identifying corresponding failed assets according to the detected anomalous symptoms. The AR system facilitates easy maintenance by highlighting the failed assets hidden behind walls/ceilings on site to the maintenance personnel. The system can thus provide enhanced support to facility managers in their daily O&M activities such as inspection, recording, communication and verification. Findings Taking the indoor temperature inspection as an example, the case study demonstrates that the O&M management process can be improved using the proposed AR-enhanced inspection system. Comparative analysis of different anomaly detection algorithms reveals that the binary segmentation-based change point detection is effective and efficient in identifying temperature anomalies. The decision-making tree supported by FTA helps formalise the linkage between temperature issues and the corresponding failed assets. Finally, the AR-based model enhanced the maintenance process by visualising and highlighting the hidden failed assets to the maintenance personnel on site. Originality/value The originality lies in bringing together the advances in augmented reality, digital twins and data-driven decision-making to support the daily O&M management activities. In particular, the paper presents a novel binary segmentation-based change point detection for identifying temperature anomalous symptoms, a decision-making tree for matching the symptoms to the failed assets, and an AR system for visualising those assets with related information.

Building defect inspection and data management using computer vision, augmented reality, and BIM technology

A real-time multi-defect automatic identification framework for concrete dams via improved YOLOv5 and knowledge distillation

Automatic concrete defect detection and reconstruction by aligning aerial images onto semantic‐rich building information model

Surface Defect-Extended BIM Generation Leveraging UAV Images and Deep Learning

A Linked Data System Framework for Sharing Construction Defect Information using Ontologies and BIM Environments

Automated joint 3D reconstruction and visual inspection for buildings using computer vision and transfer learning

Integration of Augmented Reality and Building Information Modeling for Enhanced Construction Inspection—A Case Study

Computer Vision Enabled Building Digital Twin Using Building Information Model

A Web-Based BIM–AR Quality Management System for Structural Elements

A framework to implement augmented reality based on BIM to improve operation and maintenance of mechanical facilities of commercial complexes

DEVELOPING CONSTRUCTION DEFECT MANAGEMENT SYSTEM USING BIM TECHNOLOGY IN QUALITY INSPECTION

Integrating BIM and Augmented Reality for Interactive Architectural Visualisation

Automated Geometric Quality Inspection of Prefabricated Housing Units Using BIM and LiDAR

Semi-automated visualization method for visual inspection of buildings on BIM using 3D point cloud

Towards Semi-automatic Detection and Localization of Indoor Accessibility Issues using Mobile Depth Scanning and Computer Vision

Visualised inspection system for monitoring environmental anomalies during daily operation and maintenance

Autonomous dimensional inspection and issue tracking of rebar using semantically enriched 3D models

Real-Time and Remote Construction Progress Monitoring with a Quadruped Robot Using Augmented Reality

BIMxAR: BIM-Empowered Augmented Reality for Learning Architectural Representations

Improved visualization of infrastructure monitoring data using building information modeling

Leveraging Deep Learning for Automated Reconstruction of Indoor Unstructured Elements in Scan-to-BIM