Abstract:Detecting defects in complex urban sewer scenes is crucial for urban underground structure health monitoring. However, most image-based sewer defect detection models are complex, have high resource consumption, and fail to provide detailed damage information. To increase defect detection efficiency, visualize pipelines, and enable deployment on edge devices, this paper proposes a computer vision-based robotic defect detection framework for sewers. The framework encompasses positioning, defect detection, model deployment, 3D reconstruction, and the measurement of realistic pipelines. A lightweight Sewer-YOLO-Slim model is introduced, which reconstructs the YOLOv7-tiny network by adjusting its backbone, neck, and head. Channel pruning is applied to further reduce the model's complexity. Additionally, a multiview reconstruction technique is employed to build a 3D model of the pipeline from images captured by the sewer robot, allowing for accurate measurements. The Sewer-YOLO-Slim model achieves reductions of 60.2%, 60.0%, and 65.9% in model size, parameters, and floating-point operations (FLOPs), respectively, while improving the mean average precision (mAP) by 1.5%, reaching 93.5%. Notably, the pruned model is only 4.9 MB in size. Comprehensive comparisons and analyses are conducted with 12 mainstream detection algorithms to validate the superiority of the proposed model. The model is deployed on edge devices with the aid of TensorRT for acceleration, and the detection speed reaches 15.3 ms per image. For a real section of the pipeline, the maximum measurement error of the 3D reconstruction model is 0.57 m. These results indicate that the proposed sewer inspection framework is effective, with the detection model exhibiting advanced performance in terms of accuracy, low computational demand, and real-time capability. The 3D modeling approach offers valuable insights for underground pipeline data visualization and defect measurement.

A transformer cascaded model for defect detection of sewer pipes based on confusion matrix

DefectTR: End-to-end defect detection for sewage networks using a transformer

Sewer defect instance segmentation, localization, and 3D reconstruction for sewer floating capsule robots

Vision transformer based classification of sewer defects weighted loss model

Sewer defect detection from 3D point clouds using a transformer-based deep learning model

Deep Learning-Based Automatic Defect Detection Method for Sewer Pipelines

Defect-aware transformer network for intelligent visual surface defect detection

A Dynamic Transformer Network With Early Exit Mechanism for Fast Detection of Multiscale Surface Defects

Image segmentation using Vision Transformer for tunnel defect assessment

Automatic Detection Method of Sewer Pipe Defects Using Deep Learning Techniques

Defect Detection and 3D Reconstruction of Complex Urban Underground Pipeline Scenes for Sewer Robots

Sewer pipe defect detection via deep learning with local and global feature fusion

Defect transformer: An efficient hybrid transformer architecture for surface defect detection

Automatic sewer defect detection and severity quantification based on pixel-level semantic segmentation

An Intelligent Sewer Defect Detection Method Based on Convolutional Neural Network

RDAD: A reconstructive and discriminative anomaly detection model based on transformer

Transformer‐optimized generation, detection, and tracking network for images with drainage pipeline defects

A Multi-scale Normalizing Flow Network for Surface Defects Detection

Swin Transformer Combined with Convolution Neural Network for Surface Defect Detection

Automatic Defect Detection in Sewer Network Using Deep Learning Based Object Detector