Abstract:Road pavement cracks are a critical factor affecting the health conditions of road pavements. Accurate crack detection contributes to providing data support for road maintenance measures. Compared to conventional crack detection algorithms, deep learning based crack segmentation methods have practical significance for road maintenance and traffic safety management due to their high precision and automation. However, existing deep learning methods often suffer from segmentation accuracy loss due to the varying crack sizes and the presence of stains on the pavement with spatial characteristics similar to cracks, leading to the misclassification of cracks. Therefore, this study proposed a multiscale enhanced road pavement crack segmentation network (MS-CrackSeg) by coupling spectral and spatial information to detect pavement cracks from unmanned aerial vehicle (UAV) hyperspectral imagery. MS-CrackSeg can simultaneously learn the spatial and rich spectral features of cracks in the hyperspectral imagery, improving the discrimination of those targets with similar spatial features to cracks compared to previous approaches. Moreover, the Multiscale Self-Attention-like Feature Extraction Module (MSSA) is introduced to extract and fuse multiscale crack features to enhance the crack detection. Experiments on a dataset consisting of 1031 hyperspectral images demonstrated the superior crack segmentation of the proposed method compared to the comparative methods. In particular, the proposed method achieved the highest F1-score of 0.74 and mean Intersection over Union of 0.79, indicating an exceptional performance. The developed approach offers improved data support for road maintenance measures and has validated the advantages of UAV hyperspectral imagery in road crack segmentation. The annotated hyperspectral dataset and the code for MS-CrackSeg network are available at https://github.com/williamchen-x/MS-CrackSeg.

Point Cloud-Based Pavement Crack Extraction Using MSAC and KNN Algorithm

A Three-Step Computer Vision-Based Framework for Concrete Crack Detection and Dimensions Identification

Pavement crack detection based on point cloud data and data fusion

Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques

A Deep Learning Method for Pavement Crack Identification Based on Limited Field Images

Pavement Crack Detection Based on Mobile Laser Scanning Data

Pavement Crack Extraction Method from Mobile Laser Scanning Point Cloud

Pavement Crack Classification and Recognition Algorithm Combined With Tensor Voting and RANSAC

A Multiscale Enhanced Pavement Crack Segmentation Network Coupling Spectral and Spatial Information of UAV Hyperspectral Imagery

Automated pavement crack detection and segmentation based on two‐step convolutional neural network

Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model

Pavement Damage Identification Method Based on Point Cloud Multi-Source Feature Enhancement

Two-step deep learning approach for pavement crack damage detection and segmentation

Automatic identification of pavement cracks in public roads using an optimized deep convolutional neural network model

Multi-region Segmentation Pavement Crack Detection Method Based on Deep Learning

Research on Automatic Pavement Crack Recognition Based on the Mask R-CNN Model

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

Advanced crack detection and quantification strategy based on CLAHE enhanced DeepLabv3+

Lane Crack Detection Based on Saliency

Rethinking Lightweight Convolutional Neural Networks for Efficient and High-Quality Pavement Crack Detection

PAN: Improved PointNet++ for Pavement Crack Information Extraction