Abstract:In the complex operation scene of coal mine, due to adverse environmental factors such as uneven illumination, high dust and mixed man‐machine multi‐target, the speed and measurement accuracy of traditional visual perception model decrease sharply. In order to solve the above problems, this study proposes to build a visual information perception system for coal mine comprehensive excavation working face for edge computing terminal and combines channel pruning algorithm, knowledge extraction algorithm and TensorRT acceleration engine to realize the lightweight deployment of visual perception model on edge intelligent devices. Aiming at the problems of low detection accuracy, high computational complexity and long‐time consumption of visual perception model in a complex mining environment, this research designs a visual information perception system of coal mine comprehensive excavation working face for an edge computing terminal. Firstly, the C3‐Fast feature extraction module, spatial pyramid pooling with cross‐stage partial connection (SPPCSPC) pooling module, bi‐directional feature pyramid network and lightweight decoupled detection head are used to optimize the YOLOv5s model, so as to construct the FSBD‐YOLOv5s multi‐object detection model. Secondly, the pruning and distillation algorithm is used to lighten the FSBD‐YOLOv5s model, and the model complexity is greatly reduced while maintaining the model detection accuracy. Further, the lightweight FSBD‐YOLOv5s model is migrated and deployed to the edge computing terminal platform and the TensorRT engine is used to accelerate model inference. Finally, experiments are carried out based on the data set of the coal mine comprehensive excavation working face. The experimental results show that on the edge computing terminal platform, the parameters and computational volume of the lightweight FSBD‐YOLOv5s model are reduced by 50.8% and 34.0%, while its detection accuracy and speed reach 94.0% and 43.7 fps, which can fully satisfy the requirements of the accuracy and real‐time for the coal mine engineering applications.

A Multi-Agents Visual Federated Learning Framework for Underground Coal Mines

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Visual information perception system of coal mine comprehensive excavation working face for edge computing terminal

Multi-Agent Visualization for Explaining Federated Learning.

Deep and shallow feature fusion framework for remote sensing open pit coal mine scene recognition

Object detection model of coal mine rescue robot based on multi-scale feature fusion

Autonomous Localization and Mapping Method of Mobile Robot in Underground Coal Mine Based on Edge Computing

A Multimodal Robust Simultaneous Localization and Mapping Approach Driven by Geodesic Coordinates for Coal Mine Mobile Robots

A remote VR operation system for a fully mechanised coal-mining face using real-time data and collaborative network technology

Study on the Recognition of Coal Miners’ Unsafe Behavior and Status in the Hoist Cage Based on Machine Vision

Research on visual features and identification of coal and gangue in simulated underground mine environments

Efficient Laser-Based 3D SLAM in Real Time for Coal Mine Rescue Robots

Large-Scale Underground Mine Positioning and Mapping with LiDAR-Based Semantic Intersection Detection

Multi-classifier Combined Anomaly Detection Algorithm Based On Feature Map In Underground Coal Mine

Complementary Multi–Modal Sensor Fusion for Resilient Robot Pose Estimation in Subterranean Environments

Embodied Intelligence in Mining: Leveraging Multi-Modal Large Language Models for Autonomous Driving in Mines

Coalbed methane concentration prediction and early-warning in fully mechanized mining face based on deep learning

Coal-Rock Image Recognition Method for Complex and Harsh Environment in Coal Mine Using Deep Learning Models

A Coupled Visual and Inertial Measurement Units Method for Locating and Mapping in Coal Mine Tunnel