Abstract:<p>Timely recognition of rock fragments and their morphological sizes can allow adjustment of excavation parameters during tunnel boring machine (TBM) tunnelling. Traditional manual inspection strongly relies on the experience and subjective determination of the human operators, and sieving tests cannot be conducted in real time and are energy-consuming. Rock fragments in real-world images are frequently observed against a dark background, distributed with a high size diversity, and blocked by each other. A novel deep learning-based method is proposed in this paper to achieve real-time on-site rock fragment recognition. The proposed instance segmentation model comprises two subnetworks: object detection and semantic segmentation. The object detection subnetwork is designed based on a modified single-shot detector architecture, and multilevel feature fusion, prior anchors, and self-attention modules are utilised to localise rock fragment regions. The semantic segmentation subnetwork is designed based on U-net. Down-sampling stages use the structures of the object detection subnetwork to share the extracted features of the rock fragments, and up-sampling stages employ skip connection and self-attention modules to accomplish binary segmentation in each detected bounding box. A total of 50 original images with a resolution of 4096 × 3072 were collected: 35 for training and 15 for testing. The results showed that 88.8% of the rock fragments can be recognised and that the average recall and average intersection-over-union values reach 0.87 and 0.76, respectively. Small rock fragments inevitably missed in the labelling process and extremely large ones can also be recognised. The predicted size distributions of the rock fragments fit well with the ground truth ones. Ablation experiments were conducted to further demonstrate the effectiveness of the proposed method. This study presents both visual recognition and statistical results of the size distribution of rock fragments during TBM tunnelling, which can assist in the prediction of rock properties and the adjustment of excavation parameters.</p>

Deep Learning-Based Rock Muck Detection on Point Clouds During TBM Excavation

Multi Mask Learning of Stone Segmentation for Auto-Monitoring System in TBM Construction

Real-time perception of rock–machine interaction information in TBM tunnelling using muck image analysis

Deep learning-based pixel-level rock fragment recognition during tunnel excavation using instance segmentation model

Rock segmentation visual system for assisting driving in TBM construction

Automatic Early Warning of Rockbursts from Microseismic Events by Learning the Feature-Augmented Point Cloud Representation

Identification of Surrounding Rock in TBM Excavation with Deep Neural Network

Deep learning characterization of rock conditions based on tunnel boring machine data

Prediction of geological conditions for a tunnel boring machine using big operational data

Evaluation of rock muck using image analysis and its application in the TBM tunneling

Detection method for boulders in subway shield zones based on data fusion multi-resistivity three-dimensional tomography

Automated rock mass condition assessment during TBM tunnel excavation using deep learning

Unfavorable geology recognition in front of shallow tunnel face using machine learning

A comparative study on machine learning approaches for rock mass classification using drilling data

Probabilistic machine learning approach to predict incompetent rock masses in TBM construction

Deep learning‐based automatic detection of muck types for earth pressure balance shield tunneling in soft ground

Automatic Extract of Rock Mass Spacing and Roughness Based on Point Clouds

Computer-Vision-Based Real-Time Rock Fragment Recognition During Tunnel Excavation

Classifying the surrounding rock of tunnel face using machine learning

Accurate Rock-Mass Extraction From Terrestrial Laser Point Clouds via Multiscale and Multiview Convolutional Feature Representation

Detection of TBM Tunnel Surrounding Rock Debris Based on Attention Mechanism YOLOv5