Abstract:Existing road pothole detection approaches can be classified as computer vision-based or machine learning-based. The former approaches typically employ 2D image analysis/ understanding or 3D point cloud modeling and segmentation algorithms to detect (i.e., recognize and localize) road potholes from vision sensor data, e.g., RGB images and/or depth/disparity images. The latter approaches generally address road pothole detection using convolutional neural networks (CNNs) in an end-to-end manner. However, road potholes are not necessarily ubiquitous and it is challenging to prepare a large well-annotated dataset for CNN training. In this regard, while computer vision-based methods were the mainstream research trend in the past decade, machine learning-based methods were merely discussed. Recently, we published the first stereo vision-based road pothole detection dataset and a novel disparity transformation algorithm, whereby the damaged and undamaged road areas can be highly distinguished. However, there are no benchmarks currently available for state-of-the-art (SoTA) CNNs trained using either disparity images or transformed disparity images. Therefore, in this paper, we first discuss the SoTA CNNs designed for semantic segmentation and evaluate their performance for road pothole detection with extensive experiments. Additionally, inspired by graph neural network (GNN), we propose a novel CNN layer, referred to as graph attention layer (GAL), which can be easily deployed in any existing CNN to optimize image feature representations for semantic segmentation. Our experiments compare GAL-DeepLabv3+, our best-performing implementation, with nine SoTA CNNs on three modalities of training data: RGB images, disparity images, and transformed disparity images. The experimental results suggest that our proposed GAL-DeepLabv3+ achieves the best overall pothole detection accuracy on all training data modalities. The source code, dataset, and benchmark are publicly available at mias.group/GAL-Pothole-Detection.

Graph Attention Layer Evolves Semantic Segmentation for Road Pothole Detection: A Benchmark and Algorithms

Multi-Scale Feature Fusion: Learning Better Semantic Segmentation for Road Pothole Detection

YOLOv5-Pothole: an Improved Pothole Perception Method Based on YOLOv5-Seg

Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithms

Pothole Detection Using Image Enhancement GAN and Object Detection Network

Pothole road detection and identification based on improved DeepLab V3+

Automated pothole condition assessment in pavement using photogrammetry-assisted convolutional neural network

PotholeGuard: A Pothole Detection Approach by Point Cloud Semantic Segmentation

Automatic augmentation and segmentation system for three-dimensional point cloud of pavement potholes by fusion convolution and transformer

Automated pixel-level pavement distress detection based on stereo vision and deep learning

RoadScan: A Novel and Robust Transfer Learning Framework for Autonomous Pothole Detection in Roads

Road Pothole Detection Based on Crowdsourced Data and Extended Mask R-CNN

Autonomous Pothole Detection Using Deep Region-Based Convolutional Neural Network with Cloud Computing

Automatic Detection of Pothole Distress in Asphalt Pavement Using Improved Convolutional Neural Networks

Pavement Pothole Detection Based on Cascade and Fusion Convolutional Neural Network Using 2D Images under Complex Pavement Conditions

A Lightweight Detection Method of Pavement Potholes Based on Binocular Stereo Vision and Deep Learning

3D reconstruction and segmentation system for pavement potholes based on improved structure-from-motion (SFM) and deep learning

Holistically-Nested Structure-Aware Graph Neural Network for Road Extraction

Lane and Road Marker Semantic Video Segmentation Using Mask Cropping and Optical Flow Estimation

An Iterative Semi-Supervised Approach with Pixel-wise Contrastive Loss for Road Extraction in Aerial Images

Deep Neural Networks Based Approach for Pothole Detection