Abstract:Building façades elements detection plays a key point role in façade defects detection and street scene reconstruction tasks for sustainable city development. Although the artificial intelligence technology has made a breakthrough in image segmentation, it is nontrivial to directly apply standard deep learning approaches for building façade element detection. The main reason is that the existing semantic segmentation networks have a bad performance in predicting highly regularized shapes. This research develops a hieratical deep learning framework with a symmetric loss function to automatically detect building façade elements from images. The new framework contains two types of attention modules, namely, the spatial attention module, and the channel attention module. A new loss function is designed to integrate prior engineering knowledge, which can be used to force the detection of façade elements (e.g., windows, doors, concrete walls, and sunshades) to have a highly proportionate shape. The effectiveness of the developed approach is demonstrated in two public datasets. Experimental results indicate that the developed deep learning framework with a new loss function outperforms state-of-the-art models significantly, where the achieved a Mean Intersection over Union (IoU) on the Ecole Centrale Paris(ECP) dataset (81.9%) brings an improvement of 11.3% over Fully Convolutional Network (FCN) and 4.0% over Deepfaçade, respectively, and the achieved a Mean IoU on the ArtDeco dataset (85.6%) yields an improvement of 11.4% over FCN and 5.8% over Deepfaçade, respectively. Moreover, the developed approach is more practical and effective to detect regularized façade elements, where the detection of the wall components has an IoU of 93.6% on the ECP dataset and 88.6% on the ArtDeco dataset, respectively. Overall, the contribution from the technical aspect is to develop a hieratical deep learning framework consisting of attention modules together with the newly designed loss function and the prior engineering knowledge. The contribution from the practical aspect is to realize the automatic and accurate detection for various building façade elements in complex environments, which can be potentially helpful for the infrastructure monitoring and maintenance operation.

Informativeness‐guided active learning for deep learning–based façade defects detection

An active learning method with difficulty learning mechanism for crack detection

Deep learning for detecting building façade elements from images considering prior knowledge

Knowledge Distillation Method for Surface Defect Detection.

A real-time multi-defect automatic identification framework for concrete dams via improved YOLOv5 and knowledge distillation

Semi‐supervised learning based on convolutional neural network and uncertainty filter for façade defects classification

DeepFacade: A Deep Learning Approach to Facade Parsing with Symmetric Loss.

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

BFD-YOLO: A YOLOv7-Based Detection Method for Building Façade Defects

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

An Unsupervised-Learning-Based Approach for Automated Defect Inspection on Textured Surfaces

Multi‐defect segmentation from façade images using balanced copy–paste method

Combined Anomaly Aware Weakly Supervised Lightweight Model for Surface Defect Inspection

A Novel Weakly Supervised Learning Method for Industrial Surface Defect Detection

Progressive Feature Learning for Facade Parsing with Occlusions

Ferrite Beads Surface Defect Detection Based on Spatial Attention under Weakly Supervised Learning

Automated crack segmentation in close-range building façade inspection images using deep learning techniques

A Large-Scale Measurement and Quantitative Analysis Method of Façade Color in the Urban Street Using Deep Learning

Prototype-guided domain adaptive one-stage object detector for defect detection