Abstract:Real-time road quality monitoring, involves using technologies to collect data on the conditions of the road, including information on potholes, cracks, and other defects. This information can help to improve safety for drivers and reduce costs associated with road damage. Traditional methods are time-consuming and expensive, leading to limited spatial coverage and delayed responses to road conditions. With the widespread use of smartphones and ubiquitous computing technologies, data can be collected from built-in sensors of mobile phones and in-vehicle video, on a large scale. This has raised the question of how these data can be used for road pothole detection and has significant practical relevance. Current methods either use acceleration sequence classification techniques, or image recognition techniques based on deep learning. However, accelerometer-based detection has limited coverage and is sensitive to the driving speed, while image recognition-based detection is highly affected by ambient light. To address these issues, this study proposes a method that utilizes the fusion of accelerometer data and in-vehicle video data, which is uploaded by the participating users. The preprocessed accelerometer data and intercepted video frames, were then encoded into real-valued vectors, and projected into the public space. A deep learning-based training approach was used to learn from the public space and identify road anomalies. Spatial density-based clustering was implemented in a multi-vehicle scenario, to improve reliability and optimize detection results. The performance of the model is evaluated with confusion matrix-based classification metrics. Real-world vehicle experiments are carried out, and the results demonstrate that the proposed method can improve accuracy by 6% compared to the traditional method. Consequently, the proposed method provides a novel approach for large-scale pavement anomaly detection.

Road Pothole Detection Based on Crowdsourced Data and Extended Mask R-CNN

Road Defect Detection from On-Board Cameras with Scarce and Cross-Domain Data

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Automatic Detection of Pothole Distress in Asphalt Pavement Using Improved Convolutional Neural Networks

Autonomous Pothole Detection Using Deep Region-Based Convolutional Neural Network with Cloud Computing

Pothole road detection and identification based on improved DeepLab V3+

YOLOv5-Pothole: an Improved Pothole Perception Method Based on YOLOv5-Seg

Automated pothole condition assessment in pavement using photogrammetry-assisted convolutional neural network

Pavement Pothole Detection Based on Cascade and Fusion Convolutional Neural Network Using 2D Images under Complex Pavement Conditions

One Stage Near-Ground Pothole Object Detection

RoadScan: A Novel and Robust Transfer Learning Framework for Autonomous Pothole Detection in Roads

Smart Pothole Detection Using Deep Learning Based on Dilated Convolution

An optimized deep belief network based pothole detection model for asphalt road

Sustainable Road Pothole Detection: A Crowdsourcing Based Multi-Sensors Fusion Approach

3D reconstruction and segmentation system for pavement potholes based on improved structure-from-motion (SFM) and deep learning

Research on Automatic Pavement Crack Recognition Based on the Mask R-CNN Model

Application of Various YOLO Models for Computer Vision-Based Real-Time Pothole Detection

Research on a pavement pothole extraction method based on vehicle-borne continuous laser scanning point cloud

Optimized Convolutional Forest by Particle Swarm Optimizer for Pothole Detection

A Vision-Based Pothole Detection Using CNN Model

Detection of Road Potholes by Applying Convolutional Neural Network Method Based on Road Vibration Data