Abstract:<p>Timely recognition of rock fragments and their morphological sizes can allow adjustment of excavation parameters during tunnel boring machine (TBM) tunnelling. Traditional manual inspection strongly relies on the experience and subjective determination of the human operators, and sieving tests cannot be conducted in real time and are energy-consuming. Rock fragments in real-world images are frequently observed against a dark background, distributed with a high size diversity, and blocked by each other. A novel deep learning-based method is proposed in this paper to achieve real-time on-site rock fragment recognition. The proposed instance segmentation model comprises two subnetworks: object detection and semantic segmentation. The object detection subnetwork is designed based on a modified single-shot detector architecture, and multilevel feature fusion, prior anchors, and self-attention modules are utilised to localise rock fragment regions. The semantic segmentation subnetwork is designed based on U-net. Down-sampling stages use the structures of the object detection subnetwork to share the extracted features of the rock fragments, and up-sampling stages employ skip connection and self-attention modules to accomplish binary segmentation in each detected bounding box. A total of 50 original images with a resolution of 4096 × 3072 were collected: 35 for training and 15 for testing. The results showed that 88.8% of the rock fragments can be recognised and that the average recall and average intersection-over-union values reach 0.87 and 0.76, respectively. Small rock fragments inevitably missed in the labelling process and extremely large ones can also be recognised. The predicted size distributions of the rock fragments fit well with the ground truth ones. Ablation experiments were conducted to further demonstrate the effectiveness of the proposed method. This study presents both visual recognition and statistical results of the size distribution of rock fragments during TBM tunnelling, which can assist in the prediction of rock properties and the adjustment of excavation parameters.</p>

Computer-Vision-Based Real-Time Rock Fragment Recognition During Tunnel Excavation

INSTANCE-SEGMENTATION-BASED DENSE ON-SITE ROCK FRAGMENT RECOGNITION DURING REAL-WORLD TUNNEL EXCAVATION

Deep learning-based pixel-level rock fragment recognition during tunnel excavation using instance segmentation model

Self-intersection Attention Pooling Based Classification for Rock Recognition

ViRFD: a Virtual-Realistic Fused Dataset for Rock Size Analysis in TBM Construction.

Evaluation of Real-Time Perception of Deformation State of Host Rocks in Coal Mine Roadways in Dusty Environment

Assessing Fragmentation and Potential Sliding Zones in Rock Tunnels Via Computer Vision Technology

Intelligent Identification of Discontinuity in Surrounding Rock of Tunnels Based on Three-dimensional Superpixel Segmentation

Rock fragmentation indexes reflecting rock mass quality based on real-time data of TBM tunnelling

Detection of TBM Tunnel Surrounding Rock Debris Based on Attention Mechanism YOLOv5

Evaluation Method for the Intactness of the Tunnel Face Surrounding Rock based on Tunnel Face Images

Real-time perception of rock–machine interaction information in TBM tunnelling using muck image analysis

A real-time intelligent classification model using machine learning for tunnel surrounding rock and its application

Rock segmentation visual system for assisting driving in TBM construction

An Approach to Rapidly Obtaining Rock Mass Structure Data During Highway Tunnel Construction and its Application

A Machine Vision based Rock Slag Monitoring System of Tunnel Boring Machine

A data driven real-time perception method of rock condition in TBM construction

A Novel Image-Based Approach for Interactive Characterization of Rock Fracture Spacing in a Tunnel Face

Application of Canny Operator Threshold Adaptive Segmentation Algorithm Combined with Digital Image Processing in Tunnel Face Crevice Extraction

Deep Learning-Based Rock Muck Detection on Point Clouds During TBM Excavation

Intelligent image-based identification and 3-D reconstruction of rock fractures: Implementation and application