Abstract:The coal-gangue recognition technology plays an important role in the intelligent realization of fully mechanized caving face and the improvement of coal quality. Although great progress has been made for the coal-gangue recognition in recent years, most of them have not taken into account the impact of the complex environment of top coal caving on recognition performance. Herein, a hybrid multi-branch convolutional neural network (HMBCNN) is proposed for coal-gangue recognition, which based on improved Mel Frequency Cepstral Coefficient (MFCC) as well as Mel spectrogram, and attention mechanism. Firstly, the MFCC and its smooth feature matrix are input into each branch of one-dimensional multi-branch convolutional neural network, and the spliced features are extracted adaptively through multi-head attention mechanism. Secondly, the Mel spectrogram and its first-order derivative are input into each branch of the two-dimensional multi-branch convolutional neural network respectively, and the effective time-frequency information is paid attention to through the soft attention mechanism. Finally, at the decision-making level, the two networks are fused to establish a model for feature fusion and classification, obtaining optimal fusion strategies for different features and networks. A database of sound pressure signals under different signal-to-noise ratios and equipment operations is constructed based on a large amount of data collected in the laboratory and on-site. Comparative experiments and discussions are conducted on this database with advanced algorithms and different neural network structures. The results show that the proposed method achieves higher recognition accuracy and better robustness in noisy environments.

Automated Speech Recognition System for Dispatching Call Recordings in The Underground Coal Mines.

Design of Intelligent Dispatching System Based on Human Voice Adaptive Speech Recognition

An Effective Method for Longwall Automation in Thin Coal Seam.

Research on Speech Recognition of Power Grid Dispatching Based on Big Data and Deep Learning

Application Analysis of TD-SCDMA Technology in Coal Industry

Deep Speech 2: End-to-End Speech Recognition in English and Mandarin

A Convenient and Extensible Offline Chinese Speech Recognition System Based on Convolutional CTC Networks

Transsion TSUP's speech recognition system for ASRU 2023 MADASR Challenge

Speech Recognition for Air Traffic Control Via Feature Learning and End-to-end Training

An Integrated Rfid and Sensor System for Emergency Handling in Underground Coal Mines Environments

Coal-gangue sound recognition using hybrid multi-branch CNN based on attention mechanism fusion in noisy environments

A Feature Extraction Method Using Auditory Nerve Response for Collapsing Coal-Gangue Recognition

A Spoken English Teaching System Based on Speech Recognition and Machine Learning

The MineTrans Systems for IWSLT 2023 Offline Speech Translation and Speech-to-Speech Translation Tasks

A Unified Framework for Multilingual Speech Recognition in Air Traffic Control Systems

Recognition of Short-Circuit Discharge Sounds in Transmission Lines Based on Hybrid Voiceprint Features

SpeechNet: Weakly Supervised, End-to-End Speech Recognition at Industrial Scale

A Chinese speech recognition system

Speech Selection and Environmental Adaptation for Asynchronous Speech Recognition

Research and design of excavation face remote reproduction and remote control systems

Design and Construction of Intelligent Voice Control System