Abstract:The automatic detection and extraction of road pothole distress is an important issue regarding healthy road structures, monitoring, and maintenance. In this paper, a new algorithm that integrates the mobile point cloud and images is proposed for the detection of road potholes. The algorithm includes three steps: 2D candidate pothole extraction from the images using a deep learning method, 3D candidate pothole extraction via a point cloud, and pothole determination by depth analysis. Because the texture features of the pothole and asphalt or concrete patches greatly differ from those of a normal road, pothole or patch distress images are used to establish a training set and train and test the deep learning system. Subsequently, the 2D candidate pothole is extracted from the images and labeled via the trained DeepLabv3+, a state-of-the-art pixel-wise classification (semantic segmentation) network. The edge of the candidate pothole in the image is then used to establish the relationship between the mobile point cloud and images. The original road point cloud around the edge of the candidate pothole is categorized into two groups, that is, interior and exterior points, according to the relationship between the point cloud and images. The exterior points are used to fit the road plane and calculate the accurate 3D shape of the candidate potholes. Finally, the interior points of a candidate pothole are used to analyze the depth distribution to determine if the candidate pothole is a pothole or patch. To verify the proposed method, two cases, including real and simulation cases, are selected. The real case is an expressway in Shanghai with a length of 26.4 km. Based on the proposed method, 77 candidate potholes are extracted by the DeepLabv3+ system; 49 potholes and 28 patches are finally filtered. The affected lanes and pothole locations are analyzed. The simulation case is selected to verify the geometric accuracy of the detected potholes. The results show that the mean accuracy of the detected potholes is ∼1.5–2.8 cm.

Autonomous Pothole Detection Using Deep Region-Based Convolutional Neural Network with Cloud Computing

Road Defect Detection from On-Board Cameras with Scarce and Cross-Domain Data

Embedded System for Road Damage Detection by Deep Convolutional Neural Network

Real-Time Pothole Detection Using Deep Learning

One Stage Near-Ground Pothole Object Detection

Pavement Pothole Detection Based on Cascade and Fusion Convolutional Neural Network Using 2D Images under Complex Pavement Conditions

Road Pothole Extraction and Safety Evaluation by Integration of Point Cloud and Images Derived from Mobile Mapping Sensors

Automated pothole condition assessment in pavement using photogrammetry-assisted convolutional neural network

Deep Neural Networks Based Approach for Pothole Detection

Deep Learning Enhanced Feature Extraction of Potholes Using Vision and LiDAR Data for Road Maintenance

A Real-time Pothole Detection Based on Deep Learning Approach

RoadScan: A Novel and Robust Transfer Learning Framework for Autonomous Pothole Detection in Roads

A Lightweight Detection Method of Pavement Potholes Based on Binocular Stereo Vision and Deep Learning

Deep Learning-based Pavement Cracks Detection via Wireless Visible Light Camera-based Network

Cutting-Edge Deep Learning Models for Real-Time Pothole Detection and Localization in Challenging Road Conditions

Use of Deep Learning Image Classification Models and Vehicle Mounted Cameras for Automatic Pavement Pothole Detection

Automatic detection of potholes using VGG-16 pre-trained network and Convolutional Neural Network

Learning to Automatically Catch Potholes in Worldwide Road Scene Images

Method for Detecting Road Pavement Damage Based on Deep Learning

Smart Pothole Detection Using Deep Learning Based on Dilated Convolution

Pothole Detection in Roads using Pretrained Model and Cloud Computing