Abstract:Despite recent breakthroughs in deep learning and computer vision fields, the pixel-wise identification of tiny objects in high-resolution images with complex disturbances remains challenging. This study proposes a modified U-net for tiny crack segmentation in real-world steel-box-girder bridges. The modified U-net adopts the common U-net framework and a novel Self-Attention-Self-Adaption (SASA) neuron as the fundamental computing element. The Self-Attention module applies softmax and gate operations to obtain the attention vector. It enables the neuron to focus on the most significant receptive fields when processing large-scale feature maps. The Self-Adaption module consists of a multiplayer perceptron subnet and achieves deeper feature extraction inside a single neuron. For data augmentation, a grid-based crack random elastic deformation (CRED) algorithm is designed to enrich the diversities and irregular shapes of distributed cracks. Grid-based uniform control nodes are first set on both input images and binary labels, random offsets are then employed on these control nodes, and bilinear interpolation is performed for the rest pixels. The proposed SASA neuron and CRED algorithm are simultaneously deployed to train the modified U-net. 200 raw images with a high resolution of 4928 x 3264 are collected, 160 for training and the rest 40 for the test. 512 x 512 patches are generated from the original images by a sliding window with an overlap of 256 as inputs. Results show that the average IoU between the recognized and ground-truth cracks reaches 0.409, which is 29.8% higher than the regular U-net. A five-fold cross-validation study is performed to verify that the proposed method is robust to different training and test images. Ablation experiments further demonstrate the effectiveness of the proposed SASA neuron and CRED algorithm. Promotions of the average IoU individually utilizing the SASA and CRED modules add up to the final promotion of the full model, indicating that the SASA and CRED modules contribute to the different stages of model and data in the training process.

A Few-Shot Attention Recurrent Residual U-Net for Crack Segmentation

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

An active learning method with difficulty learning mechanism for crack detection

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

A modified U-net for crack segmentation by Self-Attention-Self-Adaption neuron and random elastic deformation

Crack Semantic Segmentation using the U-Net with Full Attention Strategy

Automated Pavement Crack Segmentation Using U-Net-based Convolutional Neural Network

CrackW-Net: A Novel Pavement Crack Image Segmentation Convolutional Neural Network

RUC-Net: A Residual-Unet-Based Convolutional Neural Network for Pixel-Level Pavement Crack Segmentation

A novel real-time pixel-level road crack segmentation network

UP-CrackNet: Unsupervised Pixel-Wise Road Crack Detection via Adversarial Image Restoration

Crack Unet: Crack Recognition Algorithm Based on Three-Dimensional Ground Penetrating Radar Images

A Novel Multi-Scale Feature Enhancement U-Shaped Network for Pixel-Level Road Crack Segmentation

Highway Crack Segmentation From Unmanned Aerial Vehicle Images Using Deep Learning

CrackU‐net: A novel deep convolutional neural network for pixelwise pavement crack detection

Weakly supervised pavement crack semantic segmentation based on multi-scale object localization and incremental annotation refinement

Road Crack Detection by Combining Dynamic Snake Convolution and Attention Mechanism

UTE-CrackNet: transformer-guided and edge feature extraction U-shaped road crack image segmentation

FCT-Net: A dual-encoding-path network fusing atrous spatial pyramid pooling and transformer for pavement crack detection

Two-stage framework with improved U-Net based on self-supervised contrastive learning for pavement crack segmentation

BC-DUnet-based segmentation of fine cracks in bridges under a complex background