Abstract:Manual inspection of infrastructure damages such as building cracks is difficult due to the objectivity and reliability of assessment and high demands of time and costs. This can be automated using unmanned aerial vehicles (UAVs) for aerial imagery of damages. Numerous computer vision-based approaches have been applied to address the limitations of crack detection but they have their limitations that can be overcome by using various hybrid approaches based on artificial intelligence (AI) and machine learning (ML) techniques. The convolutional neural networks (CNNs), an application of the deep learning (DL) method, display remarkable potential for automatically detecting image features such as damages and are less sensitive to image noise. A modified deep hierarchical CNN architecture has been used in this study for crack detection and damage assessment in civil infrastructures. The proposed architecture is based on 16 convolution layers and a cycle generative adversarial network (CycleGAN). For this study, the crack images were collected using UAVs and open-source images of mid to high rise buildings (five stories and above) constructed during 2000 in Sydney, Australia. Conventionally, a CNN network only utilizes the last layer of convolution. However, our proposed network is based on the utility of multiple layers. Another important component of the proposed CNN architecture is the application of guided filtering (GF) and conditional random fields (CRFs) to refine the predicted outputs to get reliable results. Benchmarking data (600 images) of Sydney-based buildings damages was used to test the proposed architecture. The proposed deep hierarchical CNN architecture produced superior performance when evaluated using five methods: GF method, Baseline (BN) method, Deep-Crack BN, Deep-Crack GF, and SegNet. Overall, the GF method outperformed all other methods as indicated by the global accuracy (0.990), class average accuracy (0.939), mean intersection of the union overall classes (IoU) (0.879), precision (0.838), recall (0.879), and F-score (0.8581) values. Overall, the proposed CNN architecture provides the advantages of reduced noise, highly integrated supervision of features, adequate learning, and aggregation of both multi-scale and multilevel features during the training procedure along with the refinement of the overall output predictions.

Nazr-CNN: Fine-Grained Classification of UAV Imagery for Damage Assessment

UAVs in Disaster Management: Application of Integrated Aerial Imagery and Convolutional Neural Network for Flood Detection

Convolutional neural networks for object detection in aerial imagery for disaster response and recovery

Efficient CNN-based disaster events classification using UAV-aided images for emergency response application

Automated regional seismic damage assessment of buildings using an unmanned aerial vehicle and a convolutional neural network

Efficient building damage assessment from post-disaster aerial video using lightweight deep learning models

Deep learning for post‐hurricane aerial damage assessment of buildings

Deep learning‐based multi‐class damage detection for autonomous post‐disaster reconnaissance

Inspecting Buildings Using Drones and Computer Vision: A Machine Learning Approach to Detect Cracks and Damages

On the Deployment of Post-Disaster Building Damage Assessment Tools Using Satellite Imagery: A Deep Learning Approach.

Deep-Learning-Based Aerial Image Classification for Emergency Response Applications Using Unmanned Aerial Vehicles

Application of Deep Learning on UAV-Based Aerial Images for Flood Detection

RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery

A Deep Learning Approach for Surface Crack Classification and Segmentation in Unmanned Aerial Vehicle Assisted Infrastructure Inspections

A Precision Efficient Method for Collapsed Building Detection in Post-Earthquake UAV Images Based on the Improved NMS Algorithm and Faster R-CNN

Building Damage Detection from Post-Event Aerial Imagery Using Single Shot Multibox Detector

Multi-view deep learning for reliable post-disaster damage classification

Fully convolutional Siamese neural networks for buildings damage assessment from satellite images

Building damage annotation on post-hurricane satellite imagery based on convolutional neural networks

A hybrid UNet based approach for crop classification using Sentinel-1B synthetic aperture radar images