Abstract:Road pavement damage affects driving comfort markedly, threatens driving safety, and may even cause traffic accidents. The traffic management department conventionally captures pavement damage information mainly using manual and vehicle-mounted equipment, which is not conducive to the detection of large-scale road pavement distress. Street-view images can provide full-view images of urban roads where the data is updated regularly by navigation map service companies, making it possible to rapidly detect pavement damage in urban areas. This paper presents a new pavement damage detection approach that is built upon an improved YOLOv5 network and street-view images. The proposed model can deal with a large-scale detection layer to improve the detection precision of large distress targets, achieving thus both cross-layer and cross-scale feature fusion by using the Generalized Feature Pyramid Network (Generalized-FPN) structure. The improved network also involves a diagonal Intersection over Union loss for regression calculation of the boundary box and builds the decoupled Head structure to achieve the decoupling detection of prediction and regression. As a result, the fusion of the weak feature information in feature layers is enhanced at different spatial scales, a more suitable method is achieved for pavement damage detection in the complex context of multi-scale street-view images, and the accuracy of the modified network is much improved in the detection of pavement distress from street-view imagery. Furthermore, We created a large image sample set for model training and testing, and a total of 156,304 street-view images, obtained from Fengtai District, Beijing, China was used for demonstrating the usefulness of the proposed network. The findings indicated that the proposed approach could effectively achieve pavement damage detection of urban roads from street-view images, with a precision average of 79.8% on the test samples. Moreover, the developed model was applied for pavement damage detection for all the roads in Fengtai District, Beijing, indicating that our method can offer viable damage data for road maintenance planning.

Pavement Damage Identification Method Based on Point Cloud Multi-Source Feature Enhancement

Pavement crack detection based on point cloud data and data fusion

Pavement Damage Identification and Evaluation in UAV-Captured Images using Gray Level Co-Occurrence Matrices and Cloud Model

Research on a pavement pothole extraction method based on vehicle-borne continuous laser scanning point cloud

Pavement Crack Detection Based on Mobile Laser Scanning Data

Automatic damage segmentation in pavement videos by fusing similar feature extraction siamese network (SFE-SNet) and pavement damage segmentation capsule network (PDS-CapsNet)

Innovative method for pavement multiple damages segmentation and measurement by the Road-Seg-CapsNet of feature fusion

Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model

Pavement Crack Extraction Method from Mobile Laser Scanning Point Cloud

A Depth Camera-Based Intelligent Method for Identifying and Quantifying Pavement Diseases

Efficient Pavement Distress Detection Based on Attention Fusion and Feature Integration

Point-Based Visual Status Evaluation of Worn Pavement Markings Based on a Feature-Binary-PointNet Network and Shape Descriptors Using LiDAR Point Clouds: A Case Study of an Expressway

3D Rutting Features Extraction Through Continuous Pavement Laser Point Cloud

Automatic Damage Detection of Pavement through DarkNet Analysis of Digital, Infrared, and Multi-Spectral Dynamic Imaging Images

Pavement Image Enhancement in Pixel-Wise Based on Multi-Level Semantic Information

Two-step deep learning approach for pavement crack damage detection and segmentation

YOLOv5s-M: A deep learning network model for road pavement damage detection from urban street-view imagery

Pavement 3D Data Denoising Algorithm Based on Cell Meshing Ellipsoid Detection

Vision-Based Pavement Marking Detection and Condition Assessment—A Case Study

Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques

Detection of Highway Pavement Damage Based on a CNN Using Grayscale and HOG Features