Abstract:In the complex operation scene of coal mine, due to adverse environmental factors such as uneven illumination, high dust and mixed man‐machine multi‐target, the speed and measurement accuracy of traditional visual perception model decrease sharply. In order to solve the above problems, this study proposes to build a visual information perception system for coal mine comprehensive excavation working face for edge computing terminal and combines channel pruning algorithm, knowledge extraction algorithm and TensorRT acceleration engine to realize the lightweight deployment of visual perception model on edge intelligent devices. Aiming at the problems of low detection accuracy, high computational complexity and long‐time consumption of visual perception model in a complex mining environment, this research designs a visual information perception system of coal mine comprehensive excavation working face for an edge computing terminal. Firstly, the C3‐Fast feature extraction module, spatial pyramid pooling with cross‐stage partial connection (SPPCSPC) pooling module, bi‐directional feature pyramid network and lightweight decoupled detection head are used to optimize the YOLOv5s model, so as to construct the FSBD‐YOLOv5s multi‐object detection model. Secondly, the pruning and distillation algorithm is used to lighten the FSBD‐YOLOv5s model, and the model complexity is greatly reduced while maintaining the model detection accuracy. Further, the lightweight FSBD‐YOLOv5s model is migrated and deployed to the edge computing terminal platform and the TensorRT engine is used to accelerate model inference. Finally, experiments are carried out based on the data set of the coal mine comprehensive excavation working face. The experimental results show that on the edge computing terminal platform, the parameters and computational volume of the lightweight FSBD‐YOLOv5s model are reduced by 50.8% and 34.0%, while its detection accuracy and speed reach 94.0% and 43.7 fps, which can fully satisfy the requirements of the accuracy and real‐time for the coal mine engineering applications.

Study on the Application of Real-time Drone Monitoring in Ordos Open-Pit Coal Mine

The status and prospect of UAV remote sensing in mine monitoring and land reclamation

Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms

Real-Time Drone Detection Using Deep Learning Approach.

Fast Detection and Recognition Method of UAV in Sky Background

Rapid Construction of Mine Line Infrastructure Using Low-altitude Unmanned Aerial Vehicle Photogrammetry

Visual information perception system of coal mine comprehensive excavation working face for edge computing terminal

A review of UAV monitoring in mining areas: current status and future perspectives

Intelligent Mining Road Object Detection Based on Multiscale Feature Fusion in Multi-UAV Networks

A Practical Methodology for Generating High-Resolution 3D Models of Open-Pit Slopes Using UAVs: Flight Path Planning and Optimization

Ground subsidence monitoring in based on UAV-LiDAR technology: a case study of a mine in the Ordos, China

Open-Pit Granite Mining Area Extraction Using UAV Aerial Images and the Novel GIPNet

A Novel Method for 3D Object Detection in Open-Pit Mine Based on Hybrid Solid-State LiDAR Point Cloud

A Drone- and Field-Based Investigation of the Land Degradation and Soil Erosion at an Opencast Coal Mine Dump after 5 Years’ Evolution of Natural Processes

Research on real-time perception method of key targets in the comprehensive excavation working face of coal mine

Forest Farm Fire Drone Monitoring System Based on Deep Learning and Unmanned Aerial Vehicle Imagery

Real-time recognition application for UAV based on YOLOv5

Real-time inspection and auxiliary shooting system of transmission line components based on unmanned aerial vehicles

YOLO-Drone:Airborne real-time detection of dense small objects from high-altitude perspective

Multitarget Real-Time Tracking Algorithm for UAV IoT

Real-Time Detection of Ground Objects Based on Unmanned Aerial Vehicle Remote Sensing with Deep Learning: Application in Excavator Detection for Pipeline Safety