Surface Defect-Extended BIM Generation Leveraging UAV Images and Deep Learning

Lei Yang,Keju Liu,Ruisi Ou,Peng Qian,Yunjie Wu,Zhuang Tian,Changping Zhu,Sining Feng,Fan Yang

DOI: https://doi.org/10.3390/s24134151

IF: 3.9

2024-06-27

Sensors

Abstract:Defect inspection of existing buildings is receiving increasing attention for digitalization transfer in the construction industry. The development of drone technology and artificial intelligence has provided powerful tools for defect inspection of buildings. However, integrating defect inspection information detected from UAV images into semantically rich building information modeling (BIM) is still challenging work due to the low defect detection accuracy and the coordinate difference between UAV images and BIM models. In this paper, a deep learning-based method coupled with transfer learning is used to detect defects accurately; and a texture mapping-based defect parameter extraction method is proposed to achieve the mapping from the image U-V coordinate system to the BIM project coordinate system. The defects are projected onto the surface of the BIM model to enrich a surface defect-extended BIM (SDE-BIM). The proposed method was validated in a defect information modeling experiment involving the No. 36 teaching building of Nantong University. The results demonstrate that the methods are widely applicable to various building inspection tasks.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

The paper attempts to address the issue of integrating building surface defect detection with Building Information Modeling (BIM). Specifically, the paper focuses on the following aspects: 1. **Improving defect detection accuracy**: Utilizing Unmanned Aerial Vehicle (UAV) images and deep learning methods to accurately detect defects on building surfaces. Traditional defect detection methods have low accuracy and are difficult to meet the requirements of building inspections, while deep learning methods can improve detection accuracy. 2. **Coordinate system alignment issue**: Solving the problem of differences between the UAV image coordinate system and the BIM model coordinate system. This is one of the key challenges in mapping defect detection results onto the BIM model surface. 3. **Constructing an extended BIM model**: Proposing a texture mapping-based method to map defect parameters from the image coordinate system to the BIM project coordinate system, thereby projecting defect information onto the BIM model surface and generating a Surface Defect Extended BIM (SDE-BIM). Through these efforts, the paper aims to achieve an efficient and accurate building surface defect detection method and seamlessly integrate it into BIM to support digital archive management and transmission.

Surface Defect-Extended BIM Generation Leveraging UAV Images and Deep Learning

Advanced-Technological UAVs-Based Enhanced Reconstruction of Edges for Building Models

Smooth Surface Defect Detection by Deep Learning Based on Wrapped Phase Map

A Novel Defect Detection System for Complex Freeform Surface Structures

Building defect inspection and data management using computer vision, augmented reality, and BIM technology

Automatic concrete defect detection and reconstruction by aligning aerial images onto semantic‐rich building information model

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Deep-Learning-Based Automated Building Information Modeling Reconstruction Using Orthophotos with Digital Surface Models

Application of Deep Learning and Unmanned Aerial Vehicle on Building Maintenance

An adaptive crack inspection method for building surface based on BIM, UAV and edge computing

3D reconstruction and automatic leakage defect quantification of metro tunnel based on SfM-Deep learning method

Automated UAV image-to-BIM registration for building façade inspection using improved generalised Hough transform

Visual Detection of Surface Defects Based on Self-Feature Comparison in Robot 3-D Printing

Post-Earthquake Building Evaluation Using UAVs: A BIM-Based Digital Twin Framework

Reactive UAV-based automatic tunnel surface defect inspection with a field test

High-resolution infrastructure defect detection dataset sourced by unmanned systems and validated with deep learning

Joining Spatial Deformable Convolution and a Dense Feature Pyramid for Surface Defect Detection

Multiple Defects Inspection of Dam Spillway Surface Using Deep Learning and 3D Reconstruction Techniques

Leveraging Deep Learning for Automated Reconstruction of Indoor Unstructured Elements in Scan-to-BIM

BIM-supported drone path planning for building exterior surface inspection

An Unsupervised-Learning-Based Approach for Automated Defect Inspection on Textured Surfaces