Abstract:Single-channel speech enhancement is a popular problem in speech enhancement and related fields, but the traditional research direction is to improve the data structure, which always faces the problem of heavily relying on training data sets. This paper proposes and tests a unique method of improving the traditional speech enhancement algorithm based on the features of speech and hearing. This method is designed based on the fundamental frequency (F0) and harmonic features of speech to emphasize the F0 (EFF) like the human auditory system (neural lateral inhibition mechanism). Therefore, it does not depend on the training data and has good scalability, which can be easily embedded in the traditional algorithm. In this paper, the Chinese speech library, the English speech library, and a variety of noise are used in the experiments. When tested, this method can improve the performance of the original algorithm in speech enhancement, especially in the case of low SNR. However, since it is an additional process, therefore the increase in intelligibility of speech may not be high sometimes compared with the increase in perception quality in the case of high SNR, like the STOI scores. But the auditory perception index, like the PESQ scores, are significantly improved, and the WSS scores are reduced as desired. After embedding the algorithm into DNN-based or SNMF-based speech enhancement algorithms, the enhancement in the PESQ scores is improved by about 5% on average, and WSS scores are reduced, while having less negative impact on the increase in STOI in the case of high SNR. The EFF is not related to the training process of the model, but it can improve the PESQ and STOI scores, and lowers the WSS scores. This suggests that fundamental frequency is an important feature in speech processing that affects speech quality. It is necessary to actively introduce fundamental frequency as a feature in speech processing. The proposed algorithm is tested on both the Chinese and English speech datasets for extensive evaluation. The results show significant improvement compared to traditional algorithms.

High frequency weighted MFCC extraction for noise robust speaker verification

Modified MFCCs for Robust Speaker Recognition

Noise-robustness of speaker verification based on the perceptual log area ratio

Application of variable frame length and frame rate in speaker verification system

Wavelet-Based Mel-Frequency Cepstral Coefficients for Speaker Identification using Hidden Markov Models

On the Importance of Components of the MFCC in Speech and Speaker Recognition.

Feature extraction with mel scale separation method on noise audio recordings

Improved multitaper PNCC feature for robust speaker verification

Short Utterance Speaker Recognition Based on Speech High Frequency Information Compensation and Dynamic Feature Enhancement Methods

Speaker Recognition Using DMFCC over Telephone Channels

Noise Estimation Using Mean Square Cross Prediction Error for Speech Enhancement

Gradient weighting for speaker verification in extremely low Signal-to-Noise Ratio

Noise Robust Speaker Recognition Based on Adaptive Frame Weighting in GMM for i-Vector Extraction.

Using Subband Mel-spectrum Centroid and Gaussian Mixture Correlation for Robust Speaker Identification

Improving Speaker Verification Performance Against Long-Term Speaker Variability

Noise Robust Speech Recognition Using Multi-Channel Based Channel Selection And ChannelWeighting.

Speech enhancement based on emphasizing the fundamental frequency integrated with SNMF/DNN

A novel hybrid feature method based on Caelen auditory model and gammatone filterbank for robust speaker recognition under noisy environment and speech coding distortion

Analysis of noise robustness of auditory features in speech recognition

Speaker Verification Using Simple Temporal Features and Pitch Synchronous Cepstral Coefficients

Energy-efficient MFCC Extraction Architecture in Mixed-Signal Domain for Automatic Speech Recognition