Abstract:Recently, extensive studies have been performed for crack detection and segmentation using deep learning and computer vision techniques to accomplish autonomous bridge inspection. These deep network models are frequently trained with a large volume of parameters to ensure good performance. However, the robust applications under real-world situations of actual bridge inspection still face significant challenges. For example, false-positive recognitions of complex background disturbances excluded in the training sets are inevitable to exist. Besides, the real-time requirement for deploying large-volume deep networks in edge computing equipment is still challenging to achieve. This study establishes a lightweight semantic segmentation model for complex concrete crack segmentation in actual bridge inspection. First, the DeepLabv3+ model is adopted as the baseline, and the backbone module is replaced by MobileNetV2 instead of ResNet101. Second, the depthwise separable convolution, atrous convolution pyramid, and inverted residual modules are utilized to reduce convolutional parameters, expand receptive fields, and alleviate gradient vanishing, respectively. Third, the dataset is enhanced with negative disturbance examples, including straight-line-like structural edges and exposed rebars, to improve the model performance against false positives without additional labeling workload. Original images with different resolutions are first collected from actual bridges, and negative samples are further added to the dataset. A total of 4303 patches in 512 × 512 are generated by a sliding window, where 3443, 430, and 430 are randomly selected for training, validation, and test. Ablation experiments demonstrate the necessity and effectiveness of using MobileNetV2 instead of ResNet101 as the backbone and adding negative examples into the dataset. The results show that the mean intersection-over-union (mIoU) for crack segmentation in various real-world scenarios reaches 0.759. The recognition rate of false positives for complex background disturbances is effectually suppressed by introducing straight-line-like structural edges and exposed rebars into the dataset. Furthermore, the average time cost gains a significant reduction of 35.1% using the established lightweight crack segmentation model with only a slight drop on IoU of 0.017.

Automatic crack recognition for concrete bridges using a fully convolutional neural network and naive Bayes data fusion based on a visual detection system

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Structural Crack Detection from Benchmark Data Sets Using Pruned Fully Convolutional Networks

Image-Based Comprehensive Maintenance and Inspection Method for Bridges Using Deep Learning

Automatic Bridge Crack Detection Using a Convolutional Neural Network

Crack Detection for Concrete Bridges with Imaged Based Deep Learning.

Research on the Efficiency of Bridge Crack Detection by Coupling Deep Learning Frameworks with Convolutional Neural Networks

Method for Bridge Crack Detection Based on Multiresolution Network

Establishment and Application of Crowd-Sensing-Based System for Bridge Structural Crack Detection

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

Application Research on Convolution Neural Network for Bridge Crack Detection

Computer Vision-Based Bridge Damage Detection Using Deep Convolutional Networks with Expectation Maximum Attention Module

A Multi-Stage Feature Aggregation and Structure Awareness Network for Concrete Bridge Crack Detection

Construction of an Intelligent Identification System for Concrete Bridge Cracks by Integrating Machine Learning and Neural Network Models

Automatic bridge crack identification from concrete surface using ResNeXt with postprocessing

Intelligent Crack Detection and Quantification in the Concrete Bridge: A Deep Learning-Assisted Image Processing Approach

Automatic Quantitative Identification of Bridge Surface Cracks Based on Deep Learning

Automatic Pixel‐Level Crack Detection and Measurement Using Fully Convolutional Network

LIGHTWEIGHT DEEP LEARNING MODEL OF SEMANTIC SEGMENTATION FOR COMPLEX CONCRETE CRACKS IN ACTUAL BRIDGE INSPECTION

Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images

Lightweight Bridge Crack Detection Method Based on SegNet and Bottleneck Depth-Separable Convolution with Residuals