Abstract:Automatic detection of corrosion and associated damages to civil infrastructures such as bridges, buildings, and roads, from aerial images captured by an Unmanned Aerial Vehicle (UAV), helps one to overcome the challenges and shortcomings (objectivity and reliability) associated with the manual inspection methods. Deep learning methods have been widely reported in the literature for civil infrastructure corrosion detection. Among them, convolutional neural networks (CNNs) display promising applicability for the automatic detection of image features less affected by image noises. Therefore, in the current study, we propose a modified version of deep hierarchical CNN architecture, based on 16 convolution layers and cycle generative adversarial network (CycleGAN), to predict pixel-wise segmentation in an end-to-end manner using the images of Bolte Bridge and sky rail areas in Victoria (Melbourne). The convolutedly designed model network proposed in the study is based on learning and aggregation of multi-scale and multilevel features while moving from the low convolutional layers to the high-level layers, thus reducing the consistency loss in images due to the inclusion of CycleGAN. The standard approaches only use the last convolutional layer, but our proposed architecture differs from these approaches and uses multiple layers. Moreover, we have used guided filtering and Conditional Random Fields (CRFs) methods to refine the prediction results. Additionally, the effectiveness of the proposed architecture was assessed using benchmarking data of 600 images of civil infrastructure. Overall, the results show that the deep hierarchical CNN architecture based on 16 convolution layers produced advanced performances when evaluated for different methods, including the baseline, PSPNet, DeepLab, and SegNet. Overall, the extended method displayed the Global Accuracy (GA); Class Average Accuracy (CAC); mean Intersection Of the Union (IOU); Precision (P); Recall (R); and F-score values of 0.989, 0.931, 0.878, 0.849, 0.818 and 0.833, respectively.

Lightweight Convolutional Neural Network-Based Method for Crane Safety Inspection

Deep Learning-Based Automatic Safety Detection System for Crack Detection

UAV vision detection method for crane surface cracks based on Faster R-CNN and image segmentation

Smartphone-based structural crack detection using pruned fully convolutional networks and edge computing

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

CorrDetector: A framework for structural corrosion detection from drone images using ensemble deep learning

Hierarchical Convolutional Neural Network with Feature Preservation and Autotuned Thresholding for Crack Detection

An modified intelligent real-time crack detection method for bridge based on improved target detection algorithm and transfer learning

Recognition and location of steel structure surface corrosion based on unmanned aerial vehicle images

Precision and Efficiency in Dam Crack Inspection: A Lightweight Object Detection Method Based on Joint Distillation for Unmanned Aerial Vehicles (Uavs)

Bridge Girder Crack Assessment Using Faster RCNN Inception V2 and Infrared Thermography

Civil Infrastructure Damage and Corrosion Detection: An Application of Machine Learning

Autonomous Identification of Bridge Concrete Cracks Using Unmanned Aircraft Images and Improved Lightweight Deep Convolutional Networks

CrackScopeNet: A Lightweight Neural Network for Rapid Crack Detection on Resource-Constrained Drone Platforms

A Dynamic Learning Network for Steel Surface Inspection Based on Structural Re-parameterization.

Automatic Bridge Crack Detection Using a Convolutional Neural Network

Application Research on Convolution Neural Network for Bridge Crack Detection

Lightweight Network-Based Surface Defect Detection Method for Steel Plates

Tiny-Machine-Learning-Based Supply Canal Surface Condition Monitoring

Image-based Onsite Object Recognition for Automatic Crane Lifting Tasks

Enhanced Faster Region Convolutional Neural Networks for Steel Surface Defect Detection