Abstract:In the complex operation scene of coal mine, due to adverse environmental factors such as uneven illumination, high dust and mixed man‐machine multi‐target, the speed and measurement accuracy of traditional visual perception model decrease sharply. In order to solve the above problems, this study proposes to build a visual information perception system for coal mine comprehensive excavation working face for edge computing terminal and combines channel pruning algorithm, knowledge extraction algorithm and TensorRT acceleration engine to realize the lightweight deployment of visual perception model on edge intelligent devices. Aiming at the problems of low detection accuracy, high computational complexity and long‐time consumption of visual perception model in a complex mining environment, this research designs a visual information perception system of coal mine comprehensive excavation working face for an edge computing terminal. Firstly, the C3‐Fast feature extraction module, spatial pyramid pooling with cross‐stage partial connection (SPPCSPC) pooling module, bi‐directional feature pyramid network and lightweight decoupled detection head are used to optimize the YOLOv5s model, so as to construct the FSBD‐YOLOv5s multi‐object detection model. Secondly, the pruning and distillation algorithm is used to lighten the FSBD‐YOLOv5s model, and the model complexity is greatly reduced while maintaining the model detection accuracy. Further, the lightweight FSBD‐YOLOv5s model is migrated and deployed to the edge computing terminal platform and the TensorRT engine is used to accelerate model inference. Finally, experiments are carried out based on the data set of the coal mine comprehensive excavation working face. The experimental results show that on the edge computing terminal platform, the parameters and computational volume of the lightweight FSBD‐YOLOv5s model are reduced by 50.8% and 34.0%, while its detection accuracy and speed reach 94.0% and 43.7 fps, which can fully satisfy the requirements of the accuracy and real‐time for the coal mine engineering applications.

Estimation of coal dust parameters via an effective image-based deep learning model

An Efficient Segmentation Model With Multipath Attention Mechanism Enabling Particle Size Characterization of Coal Dust

A VGGNet-like approach for classifying and segmenting coal dust particles with overlapping regions

An image segmentation method of pulverized coal for particle size analysis

Intelligent Prediction of Coal Mine Gas Emission Based on Deep Neural Network

Coalbed methane concentration prediction and early-warning in fully mechanized mining face based on deep learning

Coal-Rock Image Recognition Method for Complex and Harsh Environment in Coal Mine Using Deep Learning Models

Coal Image Recognition Method Based on Improved Semantic Segmentation Model of PSPNET Network

Visual information perception system of coal mine comprehensive excavation working face for edge computing terminal

Application of deep learning classification model for regional evaluation of roof pressure support evolution effects over time in coal mining face

Response Characteristics of Gas Concentration Level in Mining Process and Intelligent Recognition Method Based on BI-LSTM

Coal Wall and Roof Segmentation in the Coal Mine Working Face Based on Dynamic Graph Convolution Neural Networks

Performance evaluation of a deep learning based wet coal image classification

Construction and application of a novel WGAN-CNN-based predicting approach for dust concentration at underground coal mine working faces

Identifying Balls Feature in a Large-Scale Laser Point Cloud of a Coal Mining Environment by a Multiscale Dynamic Graph Convolution Neural Network

Investigating a three-dimensional convolution recognition model for acoustic emission signal analysis during uniaxial compression failure of coal

Real-time in situ monitoring of ash content in coal via dual-energy X-rays and an MLP neural network

Coal Identification Based on Reflection Spectroscopy and Deep Learning: Paving the Way for Efficient Coal Combustion and Pyrolysis.

Multi-information online detection of coal quality based on machine vision

Research on Coal Dust Wettability Identification Based on GA-BP Model

An Image Enhancement Method in Coal Mine Underground Based on Deep Retinex Network and Fusion Strategy