Abstract:Recent researches have shown superior performance of applying end-to-end architecture in text-to-speech (TTS) synthesis. However, considering the complex linguistic structure of Chinese, using Chinese characters directly for Mandarin TTS may suffer from the poor linguistic encoding performance, resulting in improper word tokenization and pronunciation errors. To ensure the naturalness and intelligibility of synthetic speech, state-of-the-art Mandarin TTS systems employ a list of components, such as word tokenization, part-of-speech (POS) tagging and grapheme-to-phoneme (G2P) conversion, to produce knowledge-enhanced inputs to alleviate the problems caused by linguistic encoding. These components are based on linguistic expertise and well-designed, but trained individually, leading to errors compounding for the TTS system. In this paper, to reduce the complexity of Mandarin TTS system and bring further improvement, we proposed a knowledge-based linguistic encoder for the character-based end-to-end Mandarin TTS system. Developed with multi-task learning structure, the proposed encoder can learn from linguistic analysis subtasks, providing robust and discriminative linguistic encodings for the following speech generation decoder. Experimental results demonstrate the effectiveness of the proposed framework, with word tokenization error dropped from 12.81% to 1.58%, syllable pronunciation error dropped from 10.89% to 2.81% compared with state-of-the-art baseline approach, providing mean opinion score (MOS) improvement from 3.76 to 3.87.

Initial-Final Based Embedded Mandarin TTS System

A Novel Hybrid Mandarin Speech Synthesis System Using Different Base Units for Model Training and Concatenation

A Chinese Text-to-Speech System

Script Design Based on Decision Tree with Context Vector and Acoustic Distance for Mandarin TTS.

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

An Unified and Automatic Approach of Mandarin HTS System.

A Novel Hybrid Approach for Mandarin Speech Synthesis

A novel unit selection method for concatenation speech system using similarity measure

Text-To-Visual Speech in Chinese Based on Data-Driven Approach

Automatic Segmentation for TTS Units

The WISTON Text to Speech System for Blizzard 2008

A Miniature Chinese TTS System Based on Tailored Corpus

A Preliminary Study on Deep Learning-based Chinese Text to Taiwanese Speech Synthesis System

Perceptual Clustering Based Unit Selection Optimization for Concatenative Text-to-speech Synthesis

A Decision Tree Based Approach for Construction of Speech Database and Unit Selection

DOP-Tacotron: a Fast Chinese TTS System with Local-based Attention

ACOUSTIC MODEL COMPARISONS FOR AN EMBEDDED PHONEME-BASED MANDARIN NAME DIALING SYSTEM

Syllable HMM Based Mandarin TTS and Comparison with Concatenative TTS.

Mandarin-English Mixed Text to Speech Based on HCSIPA

High quality Chinese text-to-speech system - BEYOND

Knowledge-based Linguistic Encoding for End-to-End Mandarin Text-to-Speech Synthesis