Abstract:PURPOSES : This study uses deep learning image classification models and vehicle-mounted cameras to detect types of pavement distress — such as potholes, spalling, punch-outs, and patching damage — which require urgent maintenance. METHODS : For the automatic detection of pavement distress, the optimal mount location on a vehicle for a regular action camera was first determined. Using the orthogonal projection of obliquely captured surface images, morphological operations, and multi-blob image processing, candidate distressed pavement images were extracted from road surface images of a 16,036 km in-lane distance. Next, the distressed pavement images classified by experts were trained and tested for evaluation by three deep learning convolutional neural network (CNN) models: GoogLeNet, AlexNet, and VGGNet. The CNN models were image classification tools used to identify and extract the combined features of the target images via deep layers. Here, a data augmentation technique was applied to produce big distress data for training. Third, the dimensions of the detected distressed pavement patches were computed to estimate the quantity of repair materials needed. RESULTS : It was found that installing cameras 1.8 m above the ground on the exterior rear of the vehicle could provide clear pavement surface images with a resolution of 1 cm per pixel. The sensitivity analysis results of the trained GoogLeNet, AlexNet, and VGGNet models were 93 %, 86 %, and 72 %, respectively, compared to 62.7 % for the dimensional computation. Following readjustment of the image categories in the GoogLeNet model, distress detection sensitivity increased to 94.6 %. CONCLUSIONS : These findings support urgent maintenance by sending the detected distressed pavement images with the dimensions of the distressed patches and GPS coordinates to local maintenance offices in real-time.

Detection and classification of cracks and potholes in road images using texture descriptors

Intelligent Pothole Detection and Road Condition Assessment

Visual Detection of Road Cracks for Autonomous Vehicles Based on Deep Learning

Automated Pavement Cracks Detection and Classification Using Deep Learning

Adaptive Road Crack Detection System by Pavement Classification

Automatic Damage Detection of Pavement through DarkNet Analysis of Digital, Infrared, and Multi-Spectral Dynamic Imaging Images

Automated Pavement Distress Detection Using Image Processing Techniques

An automatic image processing based on Hough transform algorithm for pavement crack detection and classification

Pothole Detection and Road Damage Assessment System Utilizing Image Processing Techniques

Automated potholes detection using vibration and vision-based techniques

Convolutional neural networks for crack detection on flexible road pavements

An Efficient and Scalable Deep Learning Approach for Road Damage Detection

Use of Deep Learning Image Classification Models and Vehicle Mounted Cameras for Automatic Pavement Pothole Detection

OBJECT-BASED AND SUPERVISED DETECTION OF POTHOLES AND CRACKS FROM THE PAVEMENT IMAGES ACQUIRED BY UAV

Pavement crack detection and classification based on fusion feature of LBP and PCA with SVM

Detection of Road Cracks Using Convolutional Neural Networks and Threshold Segmentation

Detection of Road Crack Images Based on Multistage Feature Fusion and a Texture Awareness Method

Machine learning-based pavement crack detection, classification, and characterization: a review

Application of the Semi-Supervised Learning Approach for Pavement Defect Detection

Asphalt pavement patch identification with image features based on statistical properties using machine learning

Image Based Pothole Detection System through Machine Learning