Abstract:Recently, extensive studies have been performed for crack detection and segmentation using deep learning and computer vision techniques to accomplish autonomous bridge inspection. These deep network models are frequently trained with a large volume of parameters to ensure good performance. However, the robust applications under real-world situations of actual bridge inspection still face significant challenges. For example, false-positive recognitions of complex background disturbances excluded in the training sets are inevitable to exist. Besides, the real-time requirement for deploying large-volume deep networks in edge computing equipment is still challenging to achieve. This study establishes a lightweight semantic segmentation model for complex concrete crack segmentation in actual bridge inspection. First, the DeepLabv3+ model is adopted as the baseline, and the backbone module is replaced by MobileNetV2 instead of ResNet101. Second, the depthwise separable convolution, atrous convolution pyramid, and inverted residual modules are utilized to reduce convolutional parameters, expand receptive fields, and alleviate gradient vanishing, respectively. Third, the dataset is enhanced with negative disturbance examples, including straight-line-like structural edges and exposed rebars, to improve the model performance against false positives without additional labeling workload. Original images with different resolutions are first collected from actual bridges, and negative samples are further added to the dataset. A total of 4303 patches in 512 × 512 are generated by a sliding window, where 3443, 430, and 430 are randomly selected for training, validation, and test. Ablation experiments demonstrate the necessity and effectiveness of using MobileNetV2 instead of ResNet101 as the backbone and adding negative examples into the dataset. The results show that the mean intersection-over-union (mIoU) for crack segmentation in various real-world scenarios reaches 0.759. The recognition rate of false positives for complex background disturbances is effectually suppressed by introducing straight-line-like structural edges and exposed rebars into the dataset. Furthermore, the average time cost gains a significant reduction of 35.1% using the established lightweight crack segmentation model with only a slight drop on IoU of 0.017.

Automatic concrete infrastructure crack semantic segmentation using deep learning

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

Cracklab: A high-precision and efficient concrete crack segmentation and quantification network

Quantify pixel-level detection of dam surface crack using deep learning

Bridge Crack Semantic Segmentation Based On Improved Deeplabv3+

Automatic crack detection on concrete and asphalt surfaces using semantic segmentation network with hierarchical Transformer

LIGHTWEIGHT DEEP LEARNING MODEL OF SEMANTIC SEGMENTATION FOR COMPLEX CONCRETE CRACKS IN ACTUAL BRIDGE INSPECTION

A deep learning semantic segmentation network with attention mechanism for concrete crack detection

Crack detection algorithm for concrete structures based on super-resolution reconstruction and segmentation network

Autonomous Concrete Crack Semantic Segmentation Using Deep Fully Convolutional Encoder–Decoder Network in Concrete Structures Inspection

Co-CrackSegment: A New Collaborative Deep Learning Framework for Pixel-Level Semantic Segmentation of Concrete Cracks

A hybrid deep learning pavement crack semantic segmentation

Deep Convolutional Neural Networks for Semantic Segmentation of Cracks

Semantic Recognition and Location of Cracks by Fusing Cracks Segmentation and Deep Learning

A machine vision‐based intelligent segmentation method for dam underwater cracks using swarm optimization algorithm and deep learning

Automatic Damage Detection and Diagnosis for Hydraulic Structures Using Drones and Artificial Intelligence Techniques

Robust Semantic Segmentation for Automatic Crack Detection Within Pavement Images Using Multi-Mixing of Global Context and Local Image Features

Intelligent Detection Method for Concrete Dam Surface Cracks Based on Two-Stage Transfer Learning

Intelligent Crack Detection and Quantification in the Concrete Bridge: A Deep Learning-Assisted Image Processing Approach

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module