Abstract:Recent researches have shown superior performance of applying end-to-end architecture in text-to-speech (TTS) synthesis. However, considering the complex linguistic structure of Chinese, using Chinese characters directly for Mandarin TTS may suffer from the poor linguistic encoding performance, resulting in improper word tokenization and pronunciation errors. To ensure the naturalness and intelligibility of synthetic speech, state-of-the-art Mandarin TTS systems employ a list of components, such as word tokenization, part-of-speech (POS) tagging and grapheme-to-phoneme (G2P) conversion, to produce knowledge-enhanced inputs to alleviate the problems caused by linguistic encoding. These components are based on linguistic expertise and well-designed, but trained individually, leading to errors compounding for the TTS system. In this paper, to reduce the complexity of Mandarin TTS system and bring further improvement, we proposed a knowledge-based linguistic encoder for the character-based end-to-end Mandarin TTS system. Developed with multi-task learning structure, the proposed encoder can learn from linguistic analysis subtasks, providing robust and discriminative linguistic encodings for the following speech generation decoder. Experimental results demonstrate the effectiveness of the proposed framework, with word tokenization error dropped from 12.81% to 1.58%, syllable pronunciation error dropped from 10.89% to 2.81% compared with state-of-the-art baseline approach, providing mean opinion score (MOS) improvement from 3.76 to 3.87.

A New Chinese Text-to-speech System with High Naturalness

New synthesis method based on LMA vocal tract model

High quality Chinese text-to-speech system - BEYOND

A Chinese Text-to-Speech System

KD2000 Chinese Text-To-Speech System

An Optimized Neural Network Based Prosody Model of Chinese Speech Synthesis System

HMM Based TTS for Mixed Language Text.

NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality

NaturalSpeech: End-to-End Text-to-Speech Synthesis with Human-Level Quality

Learning Prosodic Patterns for Mandarin Speech Synthesis

A Speech-Driven 3-D Lip Synthesis with Realistic Dynamics in Mandarin Chinese

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

A Study on KD-863 Chinese Text-To-Speech

A Superposed Prosodic Model for Chinese Text-To-Speech Synthesis

Prosody Learning Mechanism for Speech Synthesis System Without Text Length Limit

Prosody Model for Mandarin Text-to-Speech System

Knowledge-based Linguistic Encoding for End-to-End Mandarin Text-to-Speech Synthesis

Improved unit selection speech synthesis method utilizing subjective evaluation results on synthetic speech

A Preliminary Study on Deep Learning-based Chinese Text to Taiwanese Speech Synthesis System

A Transformer-based Chinese Non-autoregressive Speech Synthesis Scheme

An Enhanced Text Analysis Approach in Text-to-Speech Synthesis for Mandarin Chinese