Abstract:Whispering is a natural, unphonated, secondary aspect of speech communications for most people. However, it is the primary mechanism of communications for some speakers who have impaired voice production mechanisms, such as partial laryngectomees, as well as for those prescribed voice rest, which often follows surgery or damage to the larynx. Unlike most people, who choose when to whisper and when not to, these speakers may have little choice but to rely on whispers for much of their daily vocal interaction. Even though most speakers will whisper at times, and some speakers can only whisper, the majority of today’s computational speech technology systems assume or require phonated speech. This article considers conversion of whispers into natural-sounding phonated speech as a noninvasive prosthetic aid for people with voice impairments who can only whisper. As a by-product, the technique is also useful for unimpaired speakers who choose to whisper. Speech reconstruction systems can be classified into those requiring training and those that do not. Among the latter, a recent parametric reconstruction framework is explored and then enhanced through a refined estimation of plausible pitch from weighted formant differences. The improved reconstruction framework, with proposed formant-derived artificial pitch modulation, is validated through subjective and objective comparison tests alongside state-of-the-art alternatives.

Reconstruction of Pitch for Whisper-to-speech Conversion of Chinese

Reconstruction of Phonated Speech from Whispers Using Formant-Derived Plausible Pitch Modulation.

Reconstruction Of Continuous Voiced Speech From Whispers

Reconstruction Of Whisper In Chinese By Modified Melp

A Preliminary Study On Vocal Tract System Of Chinese Whispered Vowels

Recovering implicit pitch contours from formants in whispered speech

Whisper-to-speech Conversion Using Restricted Boltzmann Machine Arrays

Relationship Between Fundamental and Formant Frequency in Whispered Mandarin

An Algorithm for Formant Estimation of Whispered Speech

A Modified Adaptive Algorithm for Formant Bandwidth in Whisper Conversion.

An Audio-Visual Whisper Database in Chinese

Tone Recognition of Chinese Whispered Speech

Whisper to Normal Speech Based on Deep Neural Networks with MCC and F0 Features.

Research on Tone Features of Chinese Vowel Whispers

Whisper to Normal Speech Conversion Using Sequence-to-Sequence Mapping Model with Auditory Attention.

Acoustic Analyses of Whispered Mandarin

Formant Estimation Of Whispered Speech Based On Pole Interaction

Experiment on pitch target approximation model for generating Mandarin F0 contour

Formant frequency estimations of whispered speech in chinese

Reconstruction of Normal Speech from Whispered Speech Based on BP Neural Network

Tone confusion in spoken and whispered Mandarin Chinese