Abstract:Manual inspection of infrastructure damages such as building cracks is difficult due to the objectivity and reliability of assessment and high demands of time and costs. This can be automated using unmanned aerial vehicles (UAVs) for aerial imagery of damages. Numerous computer vision-based approaches have been applied to address the limitations of crack detection but they have their limitations that can be overcome by using various hybrid approaches based on artificial intelligence (AI) and machine learning (ML) techniques. The convolutional neural networks (CNNs), an application of the deep learning (DL) method, display remarkable potential for automatically detecting image features such as damages and are less sensitive to image noise. A modified deep hierarchical CNN architecture has been used in this study for crack detection and damage assessment in civil infrastructures. The proposed architecture is based on 16 convolution layers and a cycle generative adversarial network (CycleGAN). For this study, the crack images were collected using UAVs and open-source images of mid to high rise buildings (five stories and above) constructed during 2000 in Sydney, Australia. Conventionally, a CNN network only utilizes the last layer of convolution. However, our proposed network is based on the utility of multiple layers. Another important component of the proposed CNN architecture is the application of guided filtering (GF) and conditional random fields (CRFs) to refine the predicted outputs to get reliable results. Benchmarking data (600 images) of Sydney-based buildings damages was used to test the proposed architecture. The proposed deep hierarchical CNN architecture produced superior performance when evaluated using five methods: GF method, Baseline (BN) method, Deep-Crack BN, Deep-Crack GF, and SegNet. Overall, the GF method outperformed all other methods as indicated by the global accuracy (0.990), class average accuracy (0.939), mean intersection of the union overall classes (IoU) (0.879), precision (0.838), recall (0.879), and F-score (0.8581) values. Overall, the proposed CNN architecture provides the advantages of reduced noise, highly integrated supervision of features, adequate learning, and aggregation of both multi-scale and multilevel features during the training procedure along with the refinement of the overall output predictions.

Structural crack detection using deep convolutional neural networks

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

A Method of Crack Detection Based on Convolutional Neural Networks

Concrete Surface Crack Detection with Convolutional-based Deep Learning Models

Deep neural networks for crack detection inside structures

Structural Crack Detection from Benchmark Data Sets Using Pruned Fully Convolutional Networks

Crack Detection in Concrete Structures Using Deep Learning

Automatic Crack Detection and Calculation Based on Deep Learning and Digital Image Processing

Enhancing Structural Crack Detection through a Multiscale Multilevel Mask Deep Convolutional Neural Network and Line Similarity Index

Structural Damage-Causing Concrete Cracking Detection Based on a Deep-Learning Method

Inspecting Buildings Using Drones and Computer Vision: A Machine Learning Approach to Detect Cracks and Damages

Enhancing crack detection with convolutional neural networks and oriented non-maximal suppression

MultiScaleCrackNet: A parallel multiscale deep CNN architecture for concrete crack classification

Image-Based Concrete Crack Detection Using Convolutional Neural Network and Exhaustive Search Technique

Automated crack detection and crack depth prediction for reinforced concrete structures using deep learning

Enhanced Intelligent Identification Of Concrete Cracks Using Multi-Layered Image Preprocessing-Aided Convolutional Neural Networks

Crack Length Measurement Using Convolutional Neural Networks and Image Processing