Abstract:Improving the noise robustness of automatic speech recognition systems has been a challenging task for many years. Recently, it was found that Deep Neural Networks (DNNs) yield large performance gains over conventional GMM-HMM systems, when used in both hybrid and tandem systems. However, they are still far from the level of human expectations especially under adverse environments. Motivated by the separation-prior-to-recognition process of the human auditory system, we propose a robust spectral masking system where power spectral domain masks are predicted using a DNN trained on the same filter-bank features used for acoustic modeling. To further improve performance, Linear Input Network (LIN) adaptation is applied to both the mask estimator and the acoustic model DNNs. Since the estimation of LINs for the mask estimator requires stereo data, which is not available during testing, we proposed using the LINs estimated for the acoustic model DNNs to adapt the mask estimators. Furthermore, we used the same set of weights obtained from pre-training for the input layers of both the mask estimator and the acoustic model DNNs to ensure a better consistency for sharing LINs. Experimental results on benchmark Aurora2 and Aurora4 tasks demonstrated the effectiveness of our system, which yielded Word Error Rates (WERs) of 4.6% and 11.8% respectively. Furthermore, the simple averaging of posteriors from systems with and without spectral masking can further reduce the WERs to 4.3% on Aurora2 and 11.4% on Aurora4.

A Research on Speech Enhancement Based on Hybrid Parallel Subbands HMM and Neural Network Model

Hybrid speech recognition based on improved hidden markov model and neural network

Single-channel speech enhancement using improved progressive deep neural network and masking-based harmonic regeneration

Speech Recognition Algorithm Based on Neural Network and Hidden Markov Model

Automatic Speech Recognition : A Study and Performance Evaluation on Neural Networks and Hidden Markov Models

A New Hybrid Hmm/Ann Model For Speech Recognition

A Hybrid Speech Recognition System Based on HMM/ANN

Speech-enhanced and Noise-aware Networks for Robust Speech Recognition

Robust Speech Recognition With Speech Enhanced Deep Neural Networks

Study on the Chinese Continuous Speech Recognition under Noise Environments Based on PCANN/HMM

An Efficient Robust Asr System Based On The Combination Of Speech Enhancement And Hmm Adaptation

Speech Recognition System Based on SCHMM/ANN in Noisy Environment

Key Technology Research for Speech Recognition

A Hybrid Deep-Learning Approach for Single Channel HF-SSB Speech Enhancement

A Spectral Masking Approach to Noise-Robust Speech Recognition Using Deep Neural Networks

An investigation of spectral restoration algorithms for deep neural networks based noise robust speech recognition

Performance Optimization of Speech Recognition System with Deep Neural Network Model

Robust Speaker Recognition Algorithm

Nonlinear Statistical Matching for Subband Robust Speech Recognition

Improving robustness of deep neural networks via spectral masking for automatic speech recognition

Speech Recognition System Based on CDHMM/SOFMNN in Noisy Environment