Abstract:Recent advances of neural TTS have made "human parity" synthesized speech possible when a large amount of studio-quality training data from a voice talent is available. However, with only limited, casual recordings from an ordinary speaker, human-like TTS is still a big challenge, in addition to other artifacts like incomplete sentences, repetition of words, etc. Chinese, a language, of which the text is different from that of other roman-letter based languages like English, has no blank space between adjacent words, hence word segmentation errors can cause serious semantic confusions and unnatural prosody. In this study, with a multi-speaker TTS to accommodate the insufficient training data of a target speaker, we investigate linguistic features and Bert-derived information to improve the prosody of our Mandarin Chinese TTS. Three factors are studied: phone-related and prosody-related linguistic features; better predicted breaks with a refined Bert-CRF model; augmented phoneme sequence with character embedding derived from a Bert model. Subjective tests on in- and out-domain tasks of News, Chat and Audiobook, have shown that all factors are effective for improving prosody of our Mandarin TTS. The model with additional character embeddings from Bert is the best one, which outperforms the baseline by 0.17 MOS gain.

HMM-based Tianjin dialect speech synthesis using bilateral question set

Mandarin-English Mixed TTS Based on HCSIPA

Analysis of Chinese Interrogative Intonation and Its Synthesis in HMM-Based Synthesis System

ToneUnit: A Speech Discretization Approach for Tonal Language Speech Synthesis

Bidirectional Tone Sandhi in Tianjin Dialect: Problem and Analysis

HMM Based TTS for Mixed Language Text.

Improving Prosody with Linguistic and Bert Derived Features in Multi-Speaker Based Mandarin Chinese Neural TTS

An HMM-based Cantonese speech synthesis system

A Novel Hybrid Approach for Mandarin Speech Synthesis

A Novel Hmm-Based Tts System Using Both Continuous Hmms And Discrete Hmms

Duration optimization of speaker adaptation in Mandarin TTS

A Novel Hybrid Mandarin Speech Synthesis System Using Different Base Units for Model Training and Concatenation

Mandarin-English Mixed Text to Speech Based on HCSIPA

A Novel HTS System Using both Continuous HMMs and Discrete HMMs

Comparison of Syllable/Phone HMM Based Mandarin TTS

An Unified and Automatic Approach of Mandarin HTS System.

Probing the phonetic and phonological knowledge of tones in Mandarin TTS models

Mandarin Speech Synthesis Based on Pitch Synchronous Time-Frequency Interpolation

Real Context Model for Tone Recognition in Mandarin Conversational Telephone Speech

HMM-based Emphatic Speech Synthesis for Corrective Feedback in Computer-Aided Pronunciation Training

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis