Abstract:Whisper, as a form of speech, is not sufficiently addressed by mainstream speech applications. This is due to the fact that systems built for normal speech do not work as expected for whispered speech. A first step to building a speech application that is inclusive of whispered speech, is the successful classification of whispered speech and normal speech. Such a front-end classification system is expected to have high accuracy and low computational overhead, which is the scope of this paper. One of the characteristics of whispered speech is the absence of the fundamental frequency (or pitch), and hence the pitch harmonics as well. The presence of the pitch and pitch harmonics in normal speech, and its absence in whispered speech, is evident in the spectral envelope of the Fourier transform. We observe that this characteristic is predominant in the first quarter of the spectrum, and exploit the same as a feature. We propose the use of one dimensional convolutional neural networks (1D-CNN) to capture these features from the quartered spectral envelope (QSE). The system yields an accuracy of 99.31% when trained and tested on the wTIMIT dataset, and 100% on the CHAINS dataset. The proposed feature is compared with Mel frequency cepstral coefficients (MFCC), a staple in the speech domain. The proposed classification system is also compared with the state-of-the-art system based on log-filterbank energy (LFBE) features trained on long short-term memory (LSTM) network. The proposed system based on 1D-CNN performs better than, or as good as, the state-of-the-art across multiple experiments. It also converges sooner, with lesser computational overhead. Finally, the proposed system is evaluated under the presence of white noise at various signal-to-noise ratios and found to be robust.

Speech Enhancement in Joint Time-Frequency Domain Based on Real-Valued Discrete Gabor Transform

Forensic Speech Enhancement Based on Two-Dimensional Fractional Fourier Transform Domain

DENOISPEECH: DENOISING TEXT TO SPEECH WITH FRAME-LEVEL NOISE MODELING

Whisper intelligibility enhancement based on noise robust feature and SVM

Inet lligibil ty evaluation of enhanced whisper in joint time-freque ncy domain

Speech Enhancement Technique on Poor Noise Estimation

Enhancing Speech Better through Using Non-Uniform Critical Bands

Joint Training for Simultaneous Speech Denoising and Dereverberation with Deep Embedding Representations

A generalized time-frequency subtraction method for robust speech enhancement based on wavelet filter banks modeling of human auditory system

Speech Enhancement for Nonstationary Noise Environments

A Threshold Denoising Algorithm Based on Mathematical Morphology for Speech Enhancement

Real-Time Implementation of an Efficient Speech Enhancement Algorithm for Digital Hearing Aids

A New Real-Time Noise Suppression Algorithm for Far-Field Speech Communication Based on Recurrent Neural Network

Improved Spectral Subtraction Based on Real-time Noise Estimation

Enhancement Algorithm for Low Signal to Noise Ratio Speech

Speech Enhancement Based on Auditory Masking Properties and Log-Spectral Distance

Quartered Spectral Envelope and 1D-CNN-based Classification of Normally Phonated and Whispered Speech

A Joint Framework of Denoising Autoencoder and Generative Vocoder for Monaural Speech Enhancement

speech and noise dual-stream spectrogram refine network with speech distortion loss for robust speech recognition

A More Effective Speech Enhancement Algorithm under Non-Stationary Noise Environment

A Primary Research on Gabor Tensor Sparse Features Representation for Whispered Speech Recognition