Abstract:Road pavement damage affects driving comfort markedly, threatens driving safety, and may even cause traffic accidents. The traffic management department conventionally captures pavement damage information mainly using manual and vehicle-mounted equipment, which is not conducive to the detection of large-scale road pavement distress. Street-view images can provide full-view images of urban roads where the data is updated regularly by navigation map service companies, making it possible to rapidly detect pavement damage in urban areas. This paper presents a new pavement damage detection approach that is built upon an improved YOLOv5 network and street-view images. The proposed model can deal with a large-scale detection layer to improve the detection precision of large distress targets, achieving thus both cross-layer and cross-scale feature fusion by using the Generalized Feature Pyramid Network (Generalized-FPN) structure. The improved network also involves a diagonal Intersection over Union loss for regression calculation of the boundary box and builds the decoupled Head structure to achieve the decoupling detection of prediction and regression. As a result, the fusion of the weak feature information in feature layers is enhanced at different spatial scales, a more suitable method is achieved for pavement damage detection in the complex context of multi-scale street-view images, and the accuracy of the modified network is much improved in the detection of pavement distress from street-view imagery. Furthermore, We created a large image sample set for model training and testing, and a total of 156,304 street-view images, obtained from Fengtai District, Beijing, China was used for demonstrating the usefulness of the proposed network. The findings indicated that the proposed approach could effectively achieve pavement damage detection of urban roads from street-view images, with a precision average of 79.8% on the test samples. Moreover, the developed model was applied for pavement damage detection for all the roads in Fengtai District, Beijing, indicating that our method can offer viable damage data for road maintenance planning.

Pavement Damage Identification and Evaluation in UAV-Captured Images using Gray Level Co-Occurrence Matrices and Cloud Model

Pavement Damage Identification Method Based on Point Cloud Multi-Source Feature Enhancement

Pavement distress detection using convolutional neural networks with images captured via UAV

A Framework for Using UAVs to Detect Pavement Damage Based on Optimal Path Planning and Image Splicing

OBJECT-BASED AND SUPERVISED DETECTION OF POTHOLES AND CRACKS FROM THE PAVEMENT IMAGES ACQUIRED BY UAV

Post‐earthquake Damage Recognition and Condition Assessment of Bridges Using UAV Integrated with Deep Learning Approach

Research on detection method of pavement diseases based on Unmanned Aerial Vehicle (UAV)

YOLOv5s-M: A deep learning network model for road pavement damage detection from urban street-view imagery

Cycle-YOLO: A Efficient and Robust Framework for Pavement Damage Detection

Detection of Asphalt Pavement Potholes and Cracks Based on the Unmanned Aerial Vehicle Multispectral Imagery

Vision-Based Pavement Marking Detection and Condition Assessment—A Case Study

Automatic Detection and Assessment of Pavement Marking Defects with Street View Imagery at the City Scale

Pavement crack detection based on point cloud data and data fusion

Deep Learning Approaches in Pavement Distress Identification: A Review

Identification of Building Damage from UAV-Based Photogrammetric Point Clouds Using Supervoxel Segmentation and Latent Dirichlet Allocation Model

A Multiscale Enhanced Pavement Crack Segmentation Network Coupling Spectral and Spatial Information of UAV Hyperspectral Imagery

Towards automated detection and quantification of concrete cracks using integrated images and lidar data from unmanned aerial vehicles

Pavement crack measurement based on aerial 3D reconstruction and learning-based segmentation method

High‐resolution model reconstruction and bridge damage detection based on data fusion of unmanned aerial vehicles light detection and ranging data imagery

Model-Driven Precise Degradation Analysis Method of Highway Marking Using Mobile Laser Scanning Point Clouds

Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model