Abstract:Real-time road quality monitoring, involves using technologies to collect data on the conditions of the road, including information on potholes, cracks, and other defects. This information can help to improve safety for drivers and reduce costs associated with road damage. Traditional methods are time-consuming and expensive, leading to limited spatial coverage and delayed responses to road conditions. With the widespread use of smartphones and ubiquitous computing technologies, data can be collected from built-in sensors of mobile phones and in-vehicle video, on a large scale. This has raised the question of how these data can be used for road pothole detection and has significant practical relevance. Current methods either use acceleration sequence classification techniques, or image recognition techniques based on deep learning. However, accelerometer-based detection has limited coverage and is sensitive to the driving speed, while image recognition-based detection is highly affected by ambient light. To address these issues, this study proposes a method that utilizes the fusion of accelerometer data and in-vehicle video data, which is uploaded by the participating users. The preprocessed accelerometer data and intercepted video frames, were then encoded into real-valued vectors, and projected into the public space. A deep learning-based training approach was used to learn from the public space and identify road anomalies. Spatial density-based clustering was implemented in a multi-vehicle scenario, to improve reliability and optimize detection results. The performance of the model is evaluated with confusion matrix-based classification metrics. Real-world vehicle experiments are carried out, and the results demonstrate that the proposed method can improve accuracy by 6% compared to the traditional method. Consequently, the proposed method provides a novel approach for large-scale pavement anomaly detection.

A Road Defect Detection System Using Smartphones

Road Defect Detection from On-Board Cameras with Scarce and Cross-Domain Data

Intelligent Pothole Detection and Road Condition Assessment

Cloud-Based Collaborative Road-Damage Monitoring with Deep Learning and Smartphones

Smartphone Sensing of Road Surface Condition and Defect Detection

An Automated Machine-Learning Approach for Road Pothole Detection Using Smartphone Sensor Data

A Road Congestion Detection System Using Undedicated Mobile Phones

Embedded System for Road Damage Detection by Deep Convolutional Neural Network

Road Damage Detection and Classification Using Deep Neural Networks with Smartphone Images

Road Damage Detection Using Deep Neural Networks with Images Captured Through a Smartphone

Establishment and Application of Crowd-Sensing-Based System for Bridge Structural Crack Detection

Deep learning-based road damage detection and classification for multiple countries

RoadScan: A Novel and Robust Transfer Learning Framework for Autonomous Pothole Detection in Roads

A Computer Vision-assisted Approach to Automated Real-Time Road Infrastructure Management

Sustainable Road Pothole Detection: A Crowdsourcing Based Multi-Sensors Fusion Approach

Defects Detection & Condition Assessment of Road Infrastructure Using Deep Learning Algorithm

CRACK DETECTION AND DIMENSIONAL ASSESSMENT USING SMARTPHONE SENSORS AND DEEP LEARNING

The Assay of Potholes and Road Damage Detection

Advancing Pavement Distress Detection in Developing Countries: A Novel Deep Learning Approach with Locally-Collected Datasets

Use of Deep Learning Image Classification Models and Vehicle Mounted Cameras for Automatic Pavement Pothole Detection

Detection of Road Potholes by Applying Convolutional Neural Network Method Based on Road Vibration Data