Abstract:In the complex operation scene of coal mine, due to adverse environmental factors such as uneven illumination, high dust and mixed man‐machine multi‐target, the speed and measurement accuracy of traditional visual perception model decrease sharply. In order to solve the above problems, this study proposes to build a visual information perception system for coal mine comprehensive excavation working face for edge computing terminal and combines channel pruning algorithm, knowledge extraction algorithm and TensorRT acceleration engine to realize the lightweight deployment of visual perception model on edge intelligent devices. Aiming at the problems of low detection accuracy, high computational complexity and long‐time consumption of visual perception model in a complex mining environment, this research designs a visual information perception system of coal mine comprehensive excavation working face for an edge computing terminal. Firstly, the C3‐Fast feature extraction module, spatial pyramid pooling with cross‐stage partial connection (SPPCSPC) pooling module, bi‐directional feature pyramid network and lightweight decoupled detection head are used to optimize the YOLOv5s model, so as to construct the FSBD‐YOLOv5s multi‐object detection model. Secondly, the pruning and distillation algorithm is used to lighten the FSBD‐YOLOv5s model, and the model complexity is greatly reduced while maintaining the model detection accuracy. Further, the lightweight FSBD‐YOLOv5s model is migrated and deployed to the edge computing terminal platform and the TensorRT engine is used to accelerate model inference. Finally, experiments are carried out based on the data set of the coal mine comprehensive excavation working face. The experimental results show that on the edge computing terminal platform, the parameters and computational volume of the lightweight FSBD‐YOLOv5s model are reduced by 50.8% and 34.0%, while its detection accuracy and speed reach 94.0% and 43.7 fps, which can fully satisfy the requirements of the accuracy and real‐time for the coal mine engineering applications.

Real-time Interactive Object Extraction System for High Resolution Remote Sensing Images Based on Parallel Computing Architecture

Real-time viewing of large images based on multi-core

GPU Accelerated Real-Time Traversability Mapping.

Partition Based Real-Time Rendering Method for Large-Area Terrain Data

High-Throughput GPU Random Walk with Fine-Tuned Concurrent Query Processing

An Extended Random Walker Approach for Object Extraction by Integrating Vgi Data and Vhr Image

Real-Time Surface Topography Measurement with Graphic Processing Unit

A Mechanism of Remote Sensing Image for Parallel Processing Base on Splitting Blocks

Balancing Cpu And Gpu: Real-Time Visualization Of Large Scale 3d Scanning Models

Realization of CUDA-based Real-Time Registration and Target Localization for High-Resolution Video Images

A Parallel Approach for Contour Extraction Based on CUDA Platform

Parallel Processing of Massive Remote Sensing Images in a GPU Architecture.

Parallel Image Resample Algorithm Based on GPU for Land Remote Sensing Data Management

Visual information perception system of coal mine comprehensive excavation working face for edge computing terminal

Multi-screen Tiled Displayed, Parallel Rendering System for a Large Terrain Dataset

GPU-Based Parallel Edge Detection Algorithm for Remote Sensing Images

Optimized Algorithm Module for Large Volume Remote Sensing Image Processing System

Research of Fast Mask Dodging for Satellite Image Based on CUDA

Parallel Programming Design and Storage Optimization of Remote Sensing Image Registration Based on GPU

Applying GPU and POSIX thread technologies in massive remote sensing image data processing

Efficient Feature Detection and Effective Post-Verification for Large Scale Near-Duplicate Image Search