Abstract:Single-channel speech enhancement is a popular problem in speech enhancement and related fields, but the traditional research direction is to improve the data structure, which always faces the problem of heavily relying on training data sets. This paper proposes and tests a unique method of improving the traditional speech enhancement algorithm based on the features of speech and hearing. This method is designed based on the fundamental frequency (F0) and harmonic features of speech to emphasize the F0 (EFF) like the human auditory system (neural lateral inhibition mechanism). Therefore, it does not depend on the training data and has good scalability, which can be easily embedded in the traditional algorithm. In this paper, the Chinese speech library, the English speech library, and a variety of noise are used in the experiments. When tested, this method can improve the performance of the original algorithm in speech enhancement, especially in the case of low SNR. However, since it is an additional process, therefore the increase in intelligibility of speech may not be high sometimes compared with the increase in perception quality in the case of high SNR, like the STOI scores. But the auditory perception index, like the PESQ scores, are significantly improved, and the WSS scores are reduced as desired. After embedding the algorithm into DNN-based or SNMF-based speech enhancement algorithms, the enhancement in the PESQ scores is improved by about 5% on average, and WSS scores are reduced, while having less negative impact on the increase in STOI in the case of high SNR. The EFF is not related to the training process of the model, but it can improve the PESQ and STOI scores, and lowers the WSS scores. This suggests that fundamental frequency is an important feature in speech processing that affects speech quality. It is necessary to actively introduce fundamental frequency as a feature in speech processing. The proposed algorithm is tested on both the Chinese and English speech datasets for extensive evaluation. The results show significant improvement compared to traditional algorithms.

Predicting intelligibility of noise-suppressed speech

How Noise and Language Proficiency Influence Speech Recognition by Individual Non-Native Listeners.

Assessing Segmental Impact for Objective Speech Quality Evaluation.

Assessing Level-Dependent Segmental Contribution to the Intelligibility of Speech Processed by Single-Channel Noise-Suppression Algorithms

Non-intrusive intelligibility prediction for Mandarin speech in noise

A Composite Objective Measure on Subjective Evaluation of Speech Enhancement Algorithms

Title Non-intrusive intelligibility prediction for Mandarin speech innoise

Study on the Correlation between Objective Evaluations and Subjective Speech Quality and Intelligibility

A Data-Driven Speech Intelligibility Assessment Method Using Sum-Sorted Spectrogram Feature

On intrusive speech quality measures and a global SNR based metric

Enhancement Algorithm for Low Signal to Noise Ratio Speech

Improving Deep Neural Network Based Speech Enhancement in Low SNR Environments

Assessing the Perceptual Contributions of Level-Dependent Segments to Sentence Intelligibility.

Exploiting Hidden Representations from a DNN-based Speech Recogniser for Speech Intelligibility Prediction in Hearing-impaired Listeners

Correlation Between Audio–visual Enhancement of Speech in Different Noise Environments and SNR: A Combined Behavioral and Electrophysiological Study

Speech Enhancement Based on Short-Time Spectral Amplitude Estimates in Low SNR

Comparing the Perceptual Contributions of Cochlear-Scaled Entropy and Speech Level

Influence of Speech Recognition Ability on Acceptable Noise Level for Mandarin (Chinese) Speakers with Normal Hearing

Speech intelligibility prediction based on a physiological model of the human ear and a hierarchical spiking neural network

Speech enhancement based on emphasizing the fundamental frequency integrated with SNMF/DNN

Evaluation of Frequency-Lowering Algorithms for Intelligibility of Chinese Speech in Hearing-Aid Users