Abstract:This paper investigates deep neural networks (DNN) based on nonlinear feature mapping and statistical linear feature adaptation approaches for reducing reverberation in speech signals. In the nonlinear feature mapping approach, DNN is trained from parallel clean/distorted speech corpus to map reverberant and noisy speech coefficients (such as log magnitude spectrum) to the underlying clean speech coefficients. The constraint imposed by dynamic features (i.e., the time derivatives of the speech coefficients) are used to enhance the smoothness of predicted coefficient trajectories in two ways. One is to obtain the enhanced speech coefficients with a least square estimation from the coefficients and dynamic features predicted by DNN. The other is to incorporate the constraint of dynamic features directly into the DNN training process using a sequential cost function. In the linear feature adaptation approach, a sparse linear transform, called cross transform, is used to transform multiple frames of speech coefficients to a new feature space. The transform is estimated to maximize the likelihood of the transformed coefficients given a model of clean speech coefficients. Unlike the DNN approach, no parallel corpus is used and no assumption on distortion types is made. The two approaches are evaluated on the REVERB Challenge 2014 tasks. Both speech enhancement and automatic speech recognition (ASR) results show that the DNN-based mappings significantly reduce the reverberation in speech and improve both speech quality and ASR performance. For the speech enhancement task, the proposed dynamic feature constraint help to improve cepstral distance, frequency-weighted segmental signal-to-noise ratio (SNR), and log likelihood ratio metrics while moderately degrades the speech-to-reverberation modulation energy ratio. In addition, the cross transform feature adaptation improves the ASR performance significantly for clean-condition trained acoustic models.

Improvement Of Distant-Talking Speaker Identification Using Bottleneck Features Of Dnn

Deep Neural Network-Based Bottleneck Feature and Denoising Autoencoder-Based Dereverberation for Distant-Talking Speaker Identification.

Speaker Recognition System Based on Deep Neural Networks and Bottleneck Features

Improved Language Identification Using Deep Bottleneck Network

Combination of Bottleneck Feature Extraction and Dereverberation for Distant-Talking Speech Recognition

Deep Neural Network Derived Bottleneck Features For Accurate Audio Classification

An investigation on DNN-derived bottleneck features for GMM-HMM based robust speech recognition

Speech Dereverberation for Enhancement and Recognition Using Dynamic Features Constrained Deep Neural Networks and Feature Adaptation

Performance Evaluation of Deep Bottleneck Features for Spoken Language Identification

Study on Continuous Speech Recognition based on Bottleneck Features for Lhasa-Tibetan Dialect

Investigation Of Bottleneck Features And Multilingual Deep Neural Networks For Speaker Verification

End-to-End Feature Learning for Text-Independent Speaker Verification

Speech Bottleneck Feature Extraction Method Based on Overlapping Group Lasso Sparse Deep Neural Network

Deep Bottleneck Features For Spoken Language Identification

Task-aware Deep Bottleneck Features for Spoken Language Identification

DNN-Based Amplitude and Phase Feature Enhancement for Noise Robust Speaker Identification

Improving Blstm Rnn Based Mandarin Speech Recognition Using Accent Dependent Bottleneck Features

Speech Selection and Environmental Adaptation for Asynchronous Speech Recognition

Distant-Talking Accent Recognition by Combining Gmm and Dnn

Improvements on bottleneck feature for large vocabulary continuous speech recognition