Abstract:Crack identification is essential for the preventive maintenance of asphalt pavement. Through periodic inspection, the characteristics of existing and emerging cracks can be obtained, and the pavement condition index can be calculated to assess pavement health. The most common method to estimate the area of cracks in an image is to count the number of grid cells or boxes that cover the cracks in an image. Accurate and efficient crack identification is the premise of crack assessment. However, the current patch‐based classification method is limited by the receptive field and cannot be used to directly classify cracks. Furthermore, the postprocessing algorithm in anchor‐based detection is not explicitly optimized for crack topology. In this paper, a new model, which is the fusion of grid‐based classification and box‐based detection based on You Only Look Once version 5 (YOLO v5) is developed and described for the first time. The accuracy and efficiency of the model are high partly due to the implementation of a shared backbone network, multi‐task learning, and joint training. The non‐maximum suppression (NMS)–area‐reduction suppression (ARS) algorithm is presented to filter redundant, overlapping prediction boxes in the postprocessing stage for the crack topology, and the mapping and matching algorithm is proposed to combine the advantages of both the grid‐based and box‐based models. A double‐labeled dataset containing tens of thousands of asphalt pavement images is assembled, and the proposed method is verified on the test set. The fusion model has superior performance over the individual classification and detection models, and the proposed NMS‐ARS algorithm further improves the detection accuracy. Experimental results demonstrate that the presented method effectively realizes automatic crack identification for asphalt pavement.

Automatic recognition of pavement cracks from combined GPR B-scan and C-scan images using multiscale feature fusion deep neural networks

Novel YOLOv3 Model with Structure and Hyperparameter Optimization for Detection of Pavement Concealed Cracks in GPR Images.

Detection of concealed cracks from ground penetrating radar images based on deep learning algorithm

Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model

Deep Learning-Enhanced Numerical Simulation of Ground Penetrating Radar and Image Detection of Road Cracks

A grid‐based classification and box‐based detection fusion model for asphalt pavement crack

GPR-based Detection of Internal Cracks in Asphalt Pavement: A Combination Method of DeepAugment Data and Object Detection

Crack-U $^2$ Net: Multiscale Feature Learning Network for Pavement Crack Detection from Large-Scale MLS Point Clouds

A lightweight feature attention fusion network for pavement crack segmentation

Automatic Detection and Location of Pavement Internal Distresses from Ground Penetrating Radar Images Based on Deep Learning

Concrete Highway Crack Detection Based on Visible Light and Infrared Silicate Spectrum Image Fusion

Selective Feature Fusion and Irregular-Aware Network for Pavement Crack Detection

Automatic pixel-level detection of vertical cracks in asphalt pavement based on GPR investigation and improved mask R-CNN

GGMNet: Pavement-Crack Detection Based on Global Context Awareness and Multi-Scale Fusion

Pavement crack detection based on point cloud data and data fusion

Multi-scale feature fusion for pavement crack detection based on Transformer

A Crack Detection Algorithm for Concrete Pavement Based on Attention Mechanism and Multi-Features Fusion

Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection

A Method of Hierarchical Feature Fusion and Connected Attention Architecture for Pavement Crack Detection

Automatic Pavement Crack Detection Fusing Attention Mechanism

Adaptive Canny and Semantic Segmentation Networks Based on Feature Fusion for Road Crack Detection