Abstract:Road pavement damage affects driving comfort markedly, threatens driving safety, and may even cause traffic accidents. The traffic management department conventionally captures pavement damage information mainly using manual and vehicle-mounted equipment, which is not conducive to the detection of large-scale road pavement distress. Street-view images can provide full-view images of urban roads where the data is updated regularly by navigation map service companies, making it possible to rapidly detect pavement damage in urban areas. This paper presents a new pavement damage detection approach that is built upon an improved YOLOv5 network and street-view images. The proposed model can deal with a large-scale detection layer to improve the detection precision of large distress targets, achieving thus both cross-layer and cross-scale feature fusion by using the Generalized Feature Pyramid Network (Generalized-FPN) structure. The improved network also involves a diagonal Intersection over Union loss for regression calculation of the boundary box and builds the decoupled Head structure to achieve the decoupling detection of prediction and regression. As a result, the fusion of the weak feature information in feature layers is enhanced at different spatial scales, a more suitable method is achieved for pavement damage detection in the complex context of multi-scale street-view images, and the accuracy of the modified network is much improved in the detection of pavement distress from street-view imagery. Furthermore, We created a large image sample set for model training and testing, and a total of 156,304 street-view images, obtained from Fengtai District, Beijing, China was used for demonstrating the usefulness of the proposed network. The findings indicated that the proposed approach could effectively achieve pavement damage detection of urban roads from street-view images, with a precision average of 79.8% on the test samples. Moreover, the developed model was applied for pavement damage detection for all the roads in Fengtai District, Beijing, indicating that our method can offer viable damage data for road maintenance planning.

Automatic damage segmentation in pavement videos by fusing similar feature extraction siamese network (SFE-SNet) and pavement damage segmentation capsule network (PDS-CapsNet)

Innovative method for pavement multiple damages segmentation and measurement by the Road-Seg-CapsNet of feature fusion

Embedded System for Road Damage Detection by Deep Convolutional Neural Network

Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model

Pavement Damage Identification Method Based on Point Cloud Multi-Source Feature Enhancement

YOLOv5s-M: A deep learning network model for road pavement damage detection from urban street-view imagery

Automated Pavement-wide Injury State Sensing Based on Deep Learning and Virtual Models

Two-step deep learning approach for pavement crack damage detection and segmentation

Automatic Inspection and Evaluation System for Pavement Distress

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

A hybrid deep learning pavement crack semantic segmentation

A Method to Improve the Accuracy of Pavement Crack Identification by Combining a Semantic Segmentation and Edge Detection Model

Automated pavement crack detection and segmentation based on two‐step convolutional neural network

Automatic Pixel-level pavement sealed crack detection using Multi-fusion U-Net network

Pavementscapes: a large-scale hierarchical image dataset for asphalt pavement damage segmentation

Cycle-YOLO: A Efficient and Robust Framework for Pavement Damage Detection

Adaptive Canny and Semantic Segmentation Networks Based on Feature Fusion for Road Crack Detection

Deep Learning-Based Thermal Image Analysis for Pavement Defect Detection and Classification Considering Complex Pavement Conditions

A Novel Multi-Scale Feature Enhancement U-Shaped Network for Pixel-Level Road Crack Segmentation

A Pavement Crack Detection Method Based on Multiscale Attention and HFS

The Application of a Pavement Distress Detection Method Based on FS-Net