Abstract:Manual inspection of infrastructure damages such as building cracks is difficult due to the objectivity and reliability of assessment and high demands of time and costs. This can be automated using unmanned aerial vehicles (UAVs) for aerial imagery of damages. Numerous computer vision-based approaches have been applied to address the limitations of crack detection but they have their limitations that can be overcome by using various hybrid approaches based on artificial intelligence (AI) and machine learning (ML) techniques. The convolutional neural networks (CNNs), an application of the deep learning (DL) method, display remarkable potential for automatically detecting image features such as damages and are less sensitive to image noise. A modified deep hierarchical CNN architecture has been used in this study for crack detection and damage assessment in civil infrastructures. The proposed architecture is based on 16 convolution layers and a cycle generative adversarial network (CycleGAN). For this study, the crack images were collected using UAVs and open-source images of mid to high rise buildings (five stories and above) constructed during 2000 in Sydney, Australia. Conventionally, a CNN network only utilizes the last layer of convolution. However, our proposed network is based on the utility of multiple layers. Another important component of the proposed CNN architecture is the application of guided filtering (GF) and conditional random fields (CRFs) to refine the predicted outputs to get reliable results. Benchmarking data (600 images) of Sydney-based buildings damages was used to test the proposed architecture. The proposed deep hierarchical CNN architecture produced superior performance when evaluated using five methods: GF method, Baseline (BN) method, Deep-Crack BN, Deep-Crack GF, and SegNet. Overall, the GF method outperformed all other methods as indicated by the global accuracy (0.990), class average accuracy (0.939), mean intersection of the union overall classes (IoU) (0.879), precision (0.838), recall (0.879), and F-score (0.8581) values. Overall, the proposed CNN architecture provides the advantages of reduced noise, highly integrated supervision of features, adequate learning, and aggregation of both multi-scale and multilevel features during the training procedure along with the refinement of the overall output predictions.

Crack Detection Using Enhanced Hierarchical Convolutional Neural Networks

Hierarchical Convolutional Neural Network with Feature Preservation and Autotuned Thresholding for Crack Detection

Ultrasonic Array Tomography-Oriented Subsurface Crack Recognition and Cross-Section Image Reconstruction of Reinforced Concrete Structure Using Deep Neural Networks

Crack Detection and Quantification for Concrete Structures Using UAV and Transformer

Crack Detection Using Enhanced Thresholding on UAV based Collected Images

An improved deep learning convolutional neural network for crack detection based on UAV images

UAV-Driven Structural Crack Detection and Location Determination Using Convolutional Neural Networks

A Novel Approach for UAV Image Crack Detection

DeepCrack: Learning Hierarchical Convolutional Features for Crack Detection

Inspecting Buildings Using Drones and Computer Vision: A Machine Learning Approach to Detect Cracks and Damages

Deep-Learning- and Unmanned Aerial Vehicle-Based Structural Crack Detection in Concrete

A Deep Learning Approach for Surface Crack Classification and Segmentation in Unmanned Aerial Vehicle Assisted Infrastructure Inspections

Automated crack segmentation in close-range building façade inspection images using deep learning techniques

Transfer Learning-Based Crack Detection by Autonomous UAVs

UAV vision detection method for crane surface cracks based on Faster R-CNN and image segmentation

Automatic Pixel-Level Crack Detection on Dam Surface Using Deep Convolutional Network

Segmentation Detection Method for Complex Road Cracks Collected by UAV Based on HC-Unet++

Autonomous Identification of Bridge Concrete Cracks Using Unmanned Aircraft Images and Improved Lightweight Deep Convolutional Networks

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks