Abstract:Visual damage detection of infrastructure using deep learning (DL)-based computational approaches can facilitate a potential solution to reduce subjectivity yet increase the accuracy of the damage diagnoses and accessibility in a structural health monitoring (SHM) system. However, despite remarkable advances with DL-based SHM, the most significant challenges to achieving the real-time implication are the limited available defects image databases and the selection of DL networks depth. To address these challenges, this research has created a diverse dataset with concrete crack (4087) and spalling (1100) images and used it for damage condition assessment by applying convolutional neural network (CNN) algorithms. CNN-classifier models are used to identify different types of defects and semantic segmentation for labeling the defect patterns within an image. Three CNN-based models-Visual Geometry Group (VGG)19, ResNet50, and InceptionV3 are incorporated as CNN-classifiers. For semantic segmentation, two encoder-decoder models, U-Net and pyramid scene parsing network architecture are developed based on four backbone models, including VGG19, ResNet50, InceptionV3, and EfficientNetB3. The CNN-classifier models are analyzed on two optimizers-stochastic gradient descent (SGD), root mean square propagation (RMSprop), and learning rates-0.1, 0.001, and 0.0001. However, the CNN-segmentation models are analyzed for SGD and adaptive moment estimation, trained with three different learning rates-0.1, 0.01, and 0.0001, and evaluated based on accuracy, intersection over union, precision, recall, and F1-score. InceptionV3 achieves the best performance for defects classification with an accuracy of 91.98% using the RMSprop optimizer. For crack segmentation, EfficientNetB3-based U-Net, and for spalling segmentation, IncenptionV3-based U-Net model outperformed all other algorithms, with an F1-score of 95.66 and 89.43%, respectively.

Techniques for detecting and masking faults in semantic segmentation applications

Troubleshooting image segmentation models with human-in-the-loop

Transient Fault Tolerant Semantic Segmentation for Autonomous Driving

A Sub-Region Unet for Weak Defects Segmentation with Global Information and Mask-Aware Loss.

AnomalySeg: Deep Learning-Based Fast Anomaly Segmentation Approach for Surface Defect Detection

Evaluating Single Event Upsets in Deep Neural Networks for Semantic Segmentation: an embedded system perspective

Efficient and accurate semi-supervised semantic segmentation for industrial surface defects

Segment Anything in Defect Detection

Application of 1D ResNet for Multivariate Fault Detection on Semiconductor Manufacturing Equipment

Diagnostics in Semantic Segmentation

Deep Learning-Based Detection of Defects in Wafer Buffer Zone During Semiconductor Packaging Process

Advancing SEM Based Nano-Scale Defect Analysis in Semiconductor Manufacturing for Advanced IC Nodes

A nondestructive automatic defect detection method with pixelwise segmentation

Deep Learning based Defect classification and detection in SEM images: A Mask R-CNN approach

Detecting Adversarial Attacks in Semantic Segmentation via Uncertainty Estimation: A Deep Analysis

FixPix: Fixing Bad Pixels using Deep Learning

Automatic Error Detection in Integrated Circuits Image Segmentation: A Data-driven Approach.

On the Feasibility and Generality of Patch-based Adversarial Attacks on Semantic Segmentation Problems

Fault Detection by Using Instance Segmentation

A Weakly-Supervised Semantic Segmentation Approach Based on the Centroid Loss: Application to Quality Control and Inspection

Deep learning-based concrete defects classification and detection using semantic segmentation