Abstract:Crack detection is essential for inspection of existing structures and crack segmentation based on deep learning is a significant solution. However, datasets are usually one of the key issues. When building a new dataset for deep learning, laborious and time-consuming annotation of a large number of crack images is an obstacle. The aim of this study is to develop an approach that can automatically select a small portion of the most informative crack images from a large pool in order to annotate them, not to label all crack images. An active learning method with difficulty learning mechanism for crack segmentation tasks is proposed. Experiments are carried out on a crack image dataset of a steel box girder, which contains 500 images of 320 x 320 size for training, 100 for validation, and 190 for testing. In active learning experiments, the 500 images for training are acted as unlabeled image. The acquisition function in our method is compared with traditional acquisition functions, i.e., Query-By-Committee (QBC), Entropy, and Core-set. Further, comparisons are made on four common segmentation networks: U-Net, DeepLabV3, Feature Pyramid Network (FPN), and PSPNet. The results show that when training occurs with 200 (40%) of the most informative crack images that are selected by our method, the four segmentation networks can achieve 92%-95% of the obtained performance when training takes place with 500 (100%) crack images. The acquisition function in our method shows more accurate measurements of informativeness for unlabeled crack images compared to the four traditional acquisition functions at most active learning stages. Our method can select the most informative images for annotation from many unlabeled crack images automatically and accurately. Additionally, the dataset built after selecting 40% of all crack images can support crack segmentation networks that perform more than 92% when all the images are used.

An end-to-end repair-based joint training framework for weakly supervised pavement crack segmentation

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

An active learning method with difficulty learning mechanism for crack detection

Asphalt Pavement Crack Identification Based on Two-Stage Training and Multi-Branch Model Integrating Multiple Attention

Weakly supervised pavement crack semantic segmentation based on multi-scale object localization and incremental annotation refinement

A hybrid deep learning pavement crack semantic segmentation

Automated Pavement Crack Segmentation Using U-Net-based Convolutional Neural Network

DMA-Net: DeepLab With Multi-Scale Attention for Pavement Crack Segmentation

Two-stage framework with improved U-Net based on self-supervised contrastive learning for pavement crack segmentation

Distribution-aware Noisy-label Crack Segmentation

Enhanced pavement crack segmentation with minimal labeled data: a triplet attention teacher-student framework

Investigation of pavement crack detection based on deep learning method using weakly supervised instance segmentation framework

Weakly-Supervised Surface Crack Segmentation by Generating Pseudo-Labels Using Localization With a Classifier and Thresholding

Modeling Multi-Granularity Context Information Flow for Pavement Crack Detection

Co-CrackSegment: A New Collaborative Deep Learning Framework for Pixel-Level Semantic Segmentation of Concrete Cracks

Dual-path network combining CNN and transformer for pavement crack segmentation

Semi-supervised semantic segmentation using cross-consistency training for pavement crack detection

An Universal Framework for Pavement Crack Detection

Robust Semantic Segmentation for Automatic Crack Detection Within Pavement Images Using Multi-Mixing of Global Context and Local Image Features

A Multiscale Enhanced Pavement Crack Segmentation Network Coupling Spectral and Spatial Information of UAV Hyperspectral Imagery

RHA-Net: An Encoder-Decoder Network with Residual Blocks and Hybrid Attention Mechanisms for Pavement Crack Segmentation