Abstract:Whisper, as a form of speech, is not sufficiently addressed by mainstream speech applications. This is due to the fact that systems built for normal speech do not work as expected for whispered speech. A first step to building a speech application that is inclusive of whispered speech, is the successful classification of whispered speech and normal speech. Such a front-end classification system is expected to have high accuracy and low computational overhead, which is the scope of this paper. One of the characteristics of whispered speech is the absence of the fundamental frequency (or pitch), and hence the pitch harmonics as well. The presence of the pitch and pitch harmonics in normal speech, and its absence in whispered speech, is evident in the spectral envelope of the Fourier transform. We observe that this characteristic is predominant in the first quarter of the spectrum, and exploit the same as a feature. We propose the use of one dimensional convolutional neural networks (1D-CNN) to capture these features from the quartered spectral envelope (QSE). The system yields an accuracy of 99.31% when trained and tested on the wTIMIT dataset, and 100% on the CHAINS dataset. The proposed feature is compared with Mel frequency cepstral coefficients (MFCC), a staple in the speech domain. The proposed classification system is also compared with the state-of-the-art system based on log-filterbank energy (LFBE) features trained on long short-term memory (LSTM) network. The proposed system based on 1D-CNN performs better than, or as good as, the state-of-the-art across multiple experiments. It also converges sooner, with lesser computational overhead. Finally, the proposed system is evaluated under the presence of white noise at various signal-to-noise ratios and found to be robust.

Inet lligibil ty evaluation of enhanced whisper in joint time-freque ncy domain

Effect of enhancement of spectral changes on speech intelligibility and clarity preferences for the hearing impaired.

Effect of Individually Tailored Spectral Change Enhancement on Speech Intelligibility and Quality for Hearing-Impaired Listeners

A Study on Incorporating Whisper for Robust Speech Assessment

The measurement and calculation of the standard spectrum of whispered Chinese speech

Parameterization of Dominant Spectral Peak Trajectory for Whisper Speech Recognition

Evaluation of Frequency-Lowering Algorithms for Intelligibility of Chinese Speech in Hearing-Aid Users

Assessing Level-Dependent Segmental Contribution to the Intelligibility of Speech Processed by Single-Channel Noise-Suppression Algorithms

Quartered Spectral Envelope and 1D-CNN-based Classification of Normally Phonated and Whispered Speech

Exploring Conventional Enhancement and Separation Methods for Multi‐speech Enhancement in Indoor Environments

End-to-end Whispered Speech Recognition with Frequency-weighted Approaches and Pseudo Whisper Pre-training

Improving Whispered Speech Recognition Performance using Pseudo-whispered based Data Augmentation

DQ-Whisper: Joint Distillation and Quantization for Efficient Multilingual Speech Recognition

Individually tailored spectral-change enhancement for the hearing impaired.

Enhancement Algorithm for Low Signal to Noise Ratio Speech

A Speech Enhancement Algorithm Based on Computational Auditory Scene Analysis

A Study of Joint Effect on Denoising Techniques and Visual Cues to Improve Speech Intelligibility in Cochlear Implant Simulation

Perceptual Cues of Whispered Tones: Are They Really Special?

Quartered Chirp Spectral Envelope for Whispered vs Normal Speech Classification

The Ability of Temporally Integrating Acoustic Waveforms is Associated with Release of Speech from Informational Masking under Reverberant Conditions

Improved Frequency Domain Turbo Equalization with Expectation Propagation Interference Cancellation in Underwater Acoustic Communications