Abstract:Pavement defects such as cracks, net cracks, and pit slots can cause potential traffic safety problems. The timely detection and identification play a key role in reducing the harm of various pavement defects. Particularly, the recent development in deep learning (DL)-based convolution neural networks (CNNs) has shown competitive performance in image detection and classification. To detect pavement defects automatically and improve effects, a multiscale mobile attention-based network, which we termed MANet, is proposed to perform the detection of pavement defects. The architecture of the encoder-decoder is used in MANet, where the encoder adopts the MobileNet as the backbone network to extract pavement defect features. Instead of the original 3 x 3 convolution, the multiscale convolution kernels are used in depthwise separable convolution (DSConv) layers of the network. Furthermore, the hybrid attention mechanism is separately incorporated into the encoder and decoder modules to infer the significance of spatial points and interchannel relationship features for the input intermediate feature maps. The proposed approach achieves state-of-the-art performance on two publicly available benchmark datasets, i.e., the Crack500 (500 crack images with 2000 x 1500 pixels) and CFD (118 crack images with 480 x 320 pixels) datasets. The mean intersection over union (MIoU) of the proposed approach on these two datasets reaches 0.7219 and 0.7788, respectively. Ablation experiments show that the multiscale convolution and hybrid attention modules can effectively help the model extract high-level feature representations and generate more accurate pavement crack segmentation results. We further test the model on locally collected pavement crack images (131 images with 1024 x 768 pixels) and it achieves a satisfactory result. The proposed approach realizes the MIoU of 0.6514 on the local dataset and outperforms other compared baseline methods. Experimental findings demonstrate the validity and feasibility of the proposed approach and it provides a viable solution for pavement crack detection in practical application scenarios. Our code is available at https://github.com/xtu502/pavement-defects.

Pavement crack detection network based on pyramid structure and attention mechanism

A Novel Detection Method for Pavement Crack with Encoder-Decoder Architecture

A Crack Detection Algorithm for Concrete Pavement Based on Attention Mechanism and Multi-Features Fusion

Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection

A lightweight encoder–decoder network for automatic pavement crack detection

CrackUNet: A Novel Network with Joint Network-in-network Structure and Deformable Convolution for Pavement Crack Detection

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

Automated Crack Segmentation on 3D Asphalt Surfaces with Richer Attention and Hybrid Pyramid Structures

Deep Learning-based Pavement Cracks Detection via Wireless Visible Light Camera-based Network

Multi-scale context feature and cross-attention network-enabled system and software-based for pavement crack detection

Automated Pixel-Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep-Learning Network.

CrackHAM: A Novel Automatic Crack Detection Network Based on U-Net for Asphalt Pavement

Automatic Pavement Crack Detection Based on Structured Prediction with the Convolutional Neural Network

Multiscale Attention Networks for Pavement Defect Detection

RENet: Rectangular convolution pyramid and edge enhancement network for salient object detection of pavement cracks

Intelligent Detection Model Based on a Fully Convolutional Neural Network for Pavement Cracks

Pixel-Level Cracking Detection on 3D Asphalt Pavement Images Through Deep-Learning- Based CrackNet-V.

Automatic Crack Detection on Road Pavements Using Encoder-Decoder Architecture

DepthCrackNet: A Deep Learning Model for Automatic Pavement Crack Detection

Automated pavement crack detection and segmentation based on two‐step convolutional neural network

Vision-Based Crack Detection of Asphalt Pavement Using Deep Convolutional Neural Network