Abstract:Pavement defects such as cracks, net cracks, and pit slots can cause potential traffic safety problems. The timely detection and identification play a key role in reducing the harm of various pavement defects. Particularly, the recent development in deep learning (DL)-based convolution neural networks (CNNs) has shown competitive performance in image detection and classification. To detect pavement defects automatically and improve effects, a multiscale mobile attention-based network, which we termed MANet, is proposed to perform the detection of pavement defects. The architecture of the encoder-decoder is used in MANet, where the encoder adopts the MobileNet as the backbone network to extract pavement defect features. Instead of the original 3 x 3 convolution, the multiscale convolution kernels are used in depthwise separable convolution (DSConv) layers of the network. Furthermore, the hybrid attention mechanism is separately incorporated into the encoder and decoder modules to infer the significance of spatial points and interchannel relationship features for the input intermediate feature maps. The proposed approach achieves state-of-the-art performance on two publicly available benchmark datasets, i.e., the Crack500 (500 crack images with 2000 x 1500 pixels) and CFD (118 crack images with 480 x 320 pixels) datasets. The mean intersection over union (MIoU) of the proposed approach on these two datasets reaches 0.7219 and 0.7788, respectively. Ablation experiments show that the multiscale convolution and hybrid attention modules can effectively help the model extract high-level feature representations and generate more accurate pavement crack segmentation results. We further test the model on locally collected pavement crack images (131 images with 1024 x 768 pixels) and it achieves a satisfactory result. The proposed approach realizes the MIoU of 0.6514 on the local dataset and outperforms other compared baseline methods. Experimental findings demonstrate the validity and feasibility of the proposed approach and it provides a viable solution for pavement crack detection in practical application scenarios. Our code is available at https://github.com/xtu502/pavement-defects.

Weakly supervised pavement crack semantic segmentation based on multi-scale object localization and incremental annotation refinement

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

A hybrid deep learning pavement crack semantic segmentation

Weakly supervised convolutional neural network for pavement crack segmentation

Robust Semantic Segmentation for Automatic Crack Detection Within Pavement Images Using Multi-Mixing of Global Context and Local Image Features

CNN-based Network with Multi-Scale Context Feature and Attention Mechanism for Automatic Pavement Crack Segmentation

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

Automated Pavement Crack Segmentation Using U-Net-based Convolutional Neural Network

An end-to-end repair-based joint training framework for weakly supervised pavement crack segmentation

DMA-Net: DeepLab With Multi-Scale Attention for Pavement Crack Segmentation

Multi-scale context feature and cross-attention network-enabled system and software-based for pavement crack detection

Multi-Scale Semantic Map Distillation for Lightweight Pavement Crack Detection

Automated pavement crack detection and segmentation based on two‐step convolutional neural network

CrackDiffusion: A Two-Stage Semantic Segmentation Framework for Pavement Crack Combining Unsupervised and Supervised Processes

CrackW-Net: A Novel Pavement Crack Image Segmentation Convolutional Neural Network

DepthCrackNet: A Deep Learning Model for Automatic Pavement Crack Detection

Multiscale Attention Networks for Pavement Defect Detection

FCT-Net: A dual-encoding-path network fusing atrous spatial pyramid pooling and transformer for pavement crack detection

A Pavement Crack Detection Method Based on Multiscale Attention and HFS

Dual-path network combining CNN and transformer for pavement crack segmentation