Abstract:The regular three-dimensional (3D) detection of potholes is essential for the assessment of pavement conditions. However, some problems associated with the segmentation of pavement potholes, such as the scarcity of 3D point cloud data of pavement potholes and the segmentation interference of asphalt aggregate particle gaps ('False potholes'), need to be solved. Therefore, a 3D point cloud augmentation and segmentation system for pavement potholes was proposed in this paper. The system comprises a fusion 3D convolution with transformer for 3DGAN (Conv-Trans-3DGAN) and a fusion 3D convolution and transformer 3D Segmentation network called Conv-Trans-3DSeg. First, a Conv-Trans-3DGAN was developed for pavement potholes, based on the improved GAN by fusion convolution and transformer, to generate 3D point cloud data. Conv-Trans-3DGAN was used to generate high-quality 3D point cloud data for pavement potholes. Second, an innovative network of Conv-Trans-3DSeg was developed to segment 3D point cloud data for pavement potholes. The global and local features of the pothole region were extracted by Conv-Trans-3DSeg to solve the problem of asphalt aggregate gaps leading to false potholes. The segmentation accuracy and F1-score of a trained Conv-Trans-3DSeg model can reach 92.075% and 91.688% respectively. Ablation comparison experiments were conducted, and the accuracy and F1-score were improved by 4.733% and 3.03%, respectively. Compared with the better known PointNet, PointNet++, Point Transformer (PT) and PointNeXt, the accuracy of the proposed model was improved by 7.694%, 2.819%, 3.34% and 3.743% respectively; the F1 score was improved by 5.211%, 2.721%, 2.102% and 3.894% respectively. In addition, the proposed Conv-Trans-3DSeg has a segmentation efficiency of 21.3FPS. The results show that the proposed segmentation network achieves accurate and efficient recognition and segmentation of three-dimensional point cloud data of potholes.

Automatic augmentation and segmentation system for three-dimensional point cloud of pavement potholes by fusion convolution and transformer

3D reconstruction and segmentation system for pavement potholes based on improved structure-from-motion (SFM) and deep learning

PotholeGuard: A Pothole Detection Approach by Point Cloud Semantic Segmentation

Automatic Detection of Pothole Distress in Asphalt Pavement Using Improved Convolutional Neural Networks

Pavement Pothole Detection Based on Cascade and Fusion Convolutional Neural Network Using 2D Images under Complex Pavement Conditions

Research on a pavement pothole extraction method based on vehicle-borne continuous laser scanning point cloud

Innovative method for pavement multiple damages segmentation and measurement by the Road-Seg-CapsNet of feature fusion

A novel transformer-based network with attention mechanism for automatic pavement crack detection

Transformer‐optimized generation, detection, and tracking network for images with drainage pipeline defects

Automated pixel-level pavement marking detection based on a convolutional transformer

Autonomous Pothole Detection Using Deep Region-Based Convolutional Neural Network with Cloud Computing

An encoder-decoder deep learning method for multi-class object segmentation from 3D tunnel point clouds

Automatic damage segmentation in pavement videos by fusing similar feature extraction siamese network (SFE-SNet) and pavement damage segmentation capsule network (PDS-CapsNet)

Automated pixel-level pavement distress detection based on stereo vision and deep learning

Rapid extraction of pavement aggregate gradation based on point clouds using deep learning networks

FCT-Net: A dual-encoding-path network fusing atrous spatial pyramid pooling and transformer for pavement crack detection

Dual-path network combining CNN and transformer for pavement crack segmentation

Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model

Automatic Pavement Crack Detection Transformer Based on Convolutional and Sequential Feature Fusion

Automated pavement crack detection and segmentation based on two‐step convolutional neural network

Multi-Scale Feature Fusion: Learning Better Semantic Segmentation for Road Pothole Detection