Abstract:High-performance line-scan cameras are highly accurate and efficient for tunnel detection, however, the exponential growth of image data creates new challenges for real-time image processing. The inference speed of existing tunnel detection algorithms is insufficient for massive amounts of image data, and traditional data structures limit the parallelism of the detection system, thereby reducing the speed of image processing. In this study, a deep learning (DL) network is developed for real-time tunnel defect detection based on the you only look once (YOLO) family. The network includes innovative defect feature-extraction modules, optimization of the network architecture, and improvement of the decoupling heads to increase defect detection accuracy and efficiency. Furthermore, we developed critical technologies for real-time detection. First, our method employs a deployment method for DL networks based on TensorRT, which enables our network to be applied directly to C++ image acquisition programs away from the traditional DL frameworks. The proposed line-scan data structure enables the raw images to be fed into the neural network in batches, which, combined with the simultaneous technique of image acquisition, detection, and storage, significantly increases the efficiency of real-time detection. The paper demonstrates the advantages of the proposed model and hardware system through an experiment study. The test results indicate that the mean average precision and F1-score of our network were 86.07% and 84.53%, respectively, while it had 21.42 M parameters. Combined with the proposed storage strategy, a recall rate of more than 90% was achieved for defect detection. Moreover, batch image processing method has a significant advantage in terms of inference speed, with 243.9 FPS in PyTorch, 381.46 FPS in TensorRT, and 305.3 FPS in real-time detection, which is five times faster than existing defect-detection models. This study significantly increases the efficiency of tunnel lining detection, which has positive implications for the visual detection of other infrastructures.

Deep Learning-Based Defect Detection Framework for Ultra High Resolution Images of Tunnels

Lightweight Deep Learning Model for Identifying Tunnel Lining Defects Based on GPR Data

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

3D reconstruction and automatic leakage defect quantification of metro tunnel based on SfM-Deep learning method

Batched-image detection model and deployment method for tunnel lining defects using line-scan cameras based on experiments study

Defect Detection of Subway Tunnels Using Advanced U-Net Network

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

Approaches for Accuracy Improvement of the X-ray Image Defect Detection of Automobile Casting Aluminum Parts Based on Deep Learning

Automatic Defect Detection in Operational High-Speed Railway Tunnels Guided by Train-Mounted Ground Penetrating Radar Data

Automatic tunnel lining crack evaluation and measurement using deep learning

Image segmentation using Vision Transformer for tunnel defect assessment

DEVELOPMENT OF A MACHINE VISION SYSTEM FOR DAMAGE AND OBJECT DETECTION IN TUNNELS USING CONVOLUTIONAL NEURAL NETWORKS

A Hybrid Deep Learning Based Framework for Component Defect Detection of Moving Trains

Automatic defect detection of metro tunnel surfaces using a vision-based inspection system

Automatic defect detection and segmentation of tunnel surface using modified Mask R-CNN

High-speed acquisition and intelligent tunnel surface defects recognition

Automated Defect Detection in Precision Forging Ultrasonic Images Based on Deep Learning

Defect Detection and 3D Reconstruction of Complex Urban Underground Pipeline Scenes for Sewer Robots

Crack Detection of the Urban Underground Utility Tunnel Based on Residual Feature Pyramid Attention Network

Deep Learning-Based Detection of Defects in Wafer Buffer Zone During Semiconductor Packaging Process