Abstract:The increased adoption of digital assistants makes text-to-speech (TTS) synthesis systems an indispensable feature of modern mobile devices. It is hence desirable to build a system capable of generating highly intelligible speech in the presence of noise. Past studies have investigated style conversion in TTS synthesis, yet degraded synthesized quality often leads to worse intelligibility. To overcome such limitations, we proposed a novel transfer learning approach using Tacotron and WaveRNN based TTS synthesis. The proposed speech system exploits two modification strategies: (a) Lombard speaking style data and (b) Spectral Shaping and Dynamic Range Compression (SSDRC) which has been shown to provide high intelligibility gains by redistributing the signal energy on the time-frequency domain. We refer to this extension as Lombard-SSDRC TTS system. Intelligibility enhancement as quantified by the Intelligibility in Bits (SIIB-Gauss) measure shows that the proposed Lombard-SSDRC TTS system shows significant relative improvement between 110% and 130% in speech-shaped noise (SSN), and 47% to 140% in competing-speaker noise (CSN) against the state-of-the-art TTS approach. Additional subjective evaluation shows that Lombard-SSDRC TTS successfully increases the speech intelligibility with relative improvement of 455% for SSN and 104% for CSN in median keyword correction rate compared to the baseline TTS method.

Improving High Quality TTS using Circular Linear Prediction and Constant Pitch Transform

High quality, lightweight and adaptable TTS using LPCNet

Improving voice quality of HMM-based speech synthesis using voice conversion method

Synthesizing Long-Form Speech Merely from Sentence-Level Corpus with Content Extrapolation and LLM Contextual Enrichment

Enhancing Speech Intelligibility in Text-To-Speech Synthesis using Speaking Style Conversion

Hierarchical Prosody Modeling and Control in Non-Autoregressive Parallel Neural TTS

Automatic Conversion from Lexical Words to Prosodic Words for Mandarin Text-to-speech System

Incremental FastPitch: Chunk-based High Quality Text to Speech

IMPROVING NATURALNESS AND CONTROLLABILITY OF SEQUENCE-TO-SEQUENCE SPEECH SYNTHESIS BY LEARNING LOCAL PROSODY REPRESENTATIONS

Learning Prosodic Patterns for Mandarin Speech Synthesis

Enhancing audio quality for expressive Neural Text-to-Speech

StyleSpeech: Parameter-efficient Fine Tuning for Pre-trained Controllable Text-to-Speech

Towards Developing State-of-the-Art TTS Synthesisers for 13 Indian Languages with Signal Processing aided Alignments

EfficientTTS 2: Variational End-to-End Text-to-Speech Synthesis and Voice Conversion

A Novel Prosody Adaptation Method for Mandarin Concatenation-Based Text-to-speech System

High quality Chinese text-to-speech system - BEYOND

Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model

Prosodic Parameter Manipulation in TTS generated speech for Controlled Speech Generation

Pitch Prediction for Mandarin TTS with Mutual Prosodic Constraint

Speaking rate attention-based duration prediction for speed control TTS

Improved Prosody Generation by Maximizing Joint Probability of State and Longer Units