Abstract:Accurate and reliable pose estimation of boom-type roadheaders is the key to the forming quality of the tunneling face in coal mines, which is of great importance to improve tunneling efficiency and ensure the safety of coal mine production. The multi-laser-beam target-based visual localization method is an effective way to realize accurate and reliable pose estimation of a roadheader body. However, the complex background interference in coal mines brings great challenges to the stable and accurate segmentation and extraction of laser beam features, which has become the main problem faced by the long-distance visual positioning method of underground equipment. In this paper, a semantic segmentation network for underground laser beams in coal mines, RCEAU-Net, is proposed based on U-Net. The network introduces residual connections in the convolution of the encoder and decoder parts, which effectively fuses the underlying feature information and improves the gradient circulation performance of the network. At the same time, by introducing cascade multi-scale convolution in the skipping connection section, which compensates for the lack of contextual semantic information in U-Net and improves the segmentation effect of the network model on tiny laser beams at long distance. Finally, the introduction of an efficient multi-scale attention module with cross-spatial learning in the encoder enhances the feature extraction capability of the network. Furthermore, the laser beam target dataset (LBTD) is constructed based on laser beam target images collected from several coal mines, and the proposed RCEAU-Net model is then tested and verified. The experimental results show that, compared with the original U-Net, RCEAU-Net can ensure the real-time performance of laser beam segmentation while increasing the Accuracy by 0.19%, Precision by 2.53%, Recall by 22.01%, and Intersection and Union Ratio by 8.48%, which can meet the requirements of multi-laser-beam feature segmentation and extraction under complex backgrounds in coal mines, so as to further ensure the accuracy and stability of long-distance visual positioning for boom-type roadheaders and ensure the safe production in the working face.

Detection and pose measurement of underground drill pipes based on GA-PointNet++

Point Cloud and Machine Learning-Based Automated Recognition and Measurement of Corrugated Pipes and Rebars for Large Precast Concrete Beams

A Novel Intelligent Online Fire Monitoring Approach for Underground Pipe Galleries

A Simultaneous Pipe-Attribute and PIG-Pose Estimation (SPPE) Using 3-D Point Cloud in Compressible Gas Pipelines

Automatic Detection and Modeling of Underground Pipes Using a Portable 3D LiDAR System

Pipe pose estimation based on machine vision

A low-cost and real-time pose measurement method for straight pipe jacking machine based on dual-screen laser target in tunneling guidance

A Coal Mine Tunnel Deformation Detection Method Using Point Cloud Data

A dataset of drilling site object detection in underground coal mines

Method for detecting pipeline spatial attitude using point cloud alignment

Extraction of Complex Pipeline Features fromIncomplete Point Clouds

Research on Drilling Depth Measurement Technology based on Drilling Rig Parameter Monitoring

Locating Anchor Drilling Holes Based on Binocular Vision in Coal Mine Roadways

On-line Detection of Gas Pipeline Based on the Real-Time Algorithm and Network Technology with Robot

Probabilistic Mixture Model for Mapping the Underground Pipes.

RCEAU-Net: Cascade Multi-Scale Convolution and Attention-Mechanism-Based Network for Laser Beam Target Image Segmentation with Complex Background in Coal Mine

Underground Pipeline Mapping from Multipositional Data: Data Acquisition Platform and Pipeline Mapping Model.

A Novel Method for 3D Object Detection in Open-Pit Mine Based on Hybrid Solid-State LiDAR Point Cloud

DeepPipes: Learning 3D Pipelines Reconstruction from Point Clouds

Robust GICP-Based 3D LiDAR SLAM for Underground Mining Environment